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Model  II  of  the  basic  skills  intercept  trainer  for  Radar  Intercept 
Officers  was  evaluated  in  a school  environment.  Model  II  incorporated 
different  instructional  sequencing  logic,  additional  weaponry  capability, 
and  additional  graphic  features  from  Model  I (developed  under  a previous 
project).  These  added  features  were  designed  to  assist  the  student  in 
understanding  the  intercept  geometry  and  in  learning  to  use  the  B-scan 
display.  One  (N=31)  of  two  random  groups  practiced  on  a trainer  with  these 
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adciitional  graphics,  the  other  group  (N=29)  used  a version  of  the  trainer 
without  these  features. 

The  group  using  the  enhanced  trainer  took  longer  and  required  more 
problems  to  satisfy  the  trials-to-criterion  logic  used  in  the  practice 
session.  All  students  expressed  predominantly  favorable  attitudes  toward 
the  trainer. 

Two  measures  of  transfer  were  used;  a twenty-item  post-test  using 
different  problems  in  a random  sequence,  and  an  inflight  checklist 
administered  during  each  of  eleven  practice  flights  and  two  training  phases 
per  student.  The  two  groups  did  equally  well  on  the  post-test.  The 
group  using  the  enhanced  trainer  was  rated  slightly  higher  than  the  other 
on  the  inflight  checklist  on  both  of  the  inflight  trail  ing  phases. 

Explanations  for  these  results  are  discussed,  ana  recommendations 
are  offered.  The  principal  recommendation  is  that  the  self-standing, 
CAI-system-in-a- terminal,  having  been  demonstrated  to  be  a viable  and 
effective  concept  in  a Naval  training  environment,  should  be  developed 
as  an  attractive  alternative  to  (1)  large  centralized-processor,  distributed 
terminal  CAI  systems  for  use  in  remote  environments,  and  (2)  multi-million 
dollar  simulators,  for  certain  types  of  job  skills  training. 
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FIELD  EVALUATION  OF  MODEL  II  OF  THE  COMPUTER-BASED, 
INDIVIDUAL  TRAINER  FOR  THE  RADAR  INTERCEPT  OFFICER 


ABSTRACT 


Model  II  of  the  basic  skills  intercept  trainer  for  Radar  Intercept 
Officers  was  evaluated  in  a school  environment.  Model  II  incorporated 
different  instructional  sequencing  logic,  additional  weaponry  capability, 
and  additional  graphic  features  from  Model  I (developed  under  a previous 
project).  These  added  features  were  designed  to  assist  the  student  in 
understanding  intercept  geometry  and  in  learning  to  use  the  B-scan  display. 
One  (N=31)  of  two  random  groups  practiced  on  a trainer  with  these  additional 
graphics,  the  other  group  (N=29)  used  a version  of  the  trainer  without 
these  features. 

The  group  using  the  enhanced  trainer  took  longer  and  required  more 
problems  to  satisfy  the  trials -to-criterion  logic  used  in  the  practice 
session.  All  students  expressed  predominantly  favorable  attitudes  toward 
the  trainer. 

Two  measures  of  transfer  were  used:  a twenty-item  post-test  using 

different  problems  in  a random  sequence,  and  an  inflight  checklist  admin- 
istered during  each  of  eleven  practice  flights  and  two  training  phases 
per  student.  The  two  groups  did  equally  well  on  the  post-test.  The 
group  using  the  enhanced  trainer  was  rated  slightly  higher  than  the  other 
on  the  inflight  checklist  on  both  of  the  inflight  training  phases. 

Explanations  for  these  results  are  discussed,  and  recommendations 
are  offered.  The  principal  recommendation  is  that  the  self-standing, 

CAl-sys tern- in-a- terminal,  having  been  demonstrated  to  be  a viable  and 
effective  concept  in  a Naval  training  environment,  should  be  developed 
as  an  attractive  alternative  to  (1)  large  centralized-processor,  distri- 
buted terminal  CAI  systems  for  use  in  remote  environments , .and  (2)  multi- 
million dollar  simulators,  for  certain  types  of  job  skills  training. 
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FOREWOHD 


The  Naval  Training  Equipment  Center  is  engaged  in  a program  to  advance  the 
general  state  of  Computer-Aided  Instruction  (CAI).  A portion  of  this  program, 
undertaken  in  association  with  the  University  of  Southern  California,  is  described 
in  this  and  two  other  technical  reports  .(Rigney,  et  al , 1973i  Rigney,  et  al,  I97I*). 
The  present  document  reports  the  devoLopnu'nt,  field  implementation  and  experimental 
evaluation  of  an  (almost)  completely  automated  CAI  capability  for  teaching  skills 
for  the  Radar  Intercept  Officer's  (HlO's)  Job.  Contributions  made  by  this  research 
to  the  state-of-the-art  of  CAI  stem  mainly  from  demonstrations  as  follows: 


a.  Advanced  types  of  CAI,  as  employed  in  the  present  trainer,  are 
feasible  and  useful  in  field  applications. 

b.  These  advanced  CAI  features  arc  successful  when  one  property  of  the 
training  is  a simulation  of  a job  perfornnnee  situation  (the  RIO  task)  which  is 
characterized  by  dynamic,  interactive,  real-time  qualities.  (This  type  of  training 
material  is  in  contrast  with  training  materials  much  more  typically  subjected  to 
CAI  applications.  With  tiiesc  latter  materials,  programmed  instruction,  rather  than 
job  simulation,  provides  tiie  model  for  the  CAI  approach;  and  information  acquisition 
lather  than  skilled  job  performance,  is  the  major  outcome  of  instruction.) 

c . Details  concerning  the  manner  in  which  a given  feature  of  CAI  is 
utilised  is  critical  to  its  effectiveness  in  training,  and  these  details  are  not 
always  readily  apparent.  Results  related  to  the  latter  point  permit  preliminary 
statements  to  be  made  in  this  report  about  the  most  appropriate  ways  to  utilize 
some  CAI  features  in  training  applications. 


In  addition,  this  report  describes  a valuable  by-product  of  this  research 
effort,  viz.,  a new  CAI  device  for  RIO's  which  essentially  is  ready  for  use  in 
operational  training  environments.  This  computer-based  trainer  has  shown  capa- 
bilities which  suggest  considerable  superiority  to  trainers  and  training  methods 
currently  used  for  RIO  instruction  in  terms  of  cost-effectiveness.  Definitive 
evaluations  of  the  various  capabilities  of  the  trainer,  however,  await  its  more 
complete  development  and  an  experimental  t'nvironment  more  amenable  to  experimental 
manipulation  and  control.  Under  these  improved  conditions,  the  promise  of  superior 
training  and  transfer  performance  held  by  the  computer-based  aspects  of  the  trainer 
would  stand  a greater  chance  to  be  demonstrated  than  under  current  conditions. 
Complete  development  of  the  trainer  would  permi*^  comparisons  with  current  training 
capabilities  in  which  the  present  CAI  program  could  be  used  as  an  alternative, 
rather  than  as  an  auxiliary,  to  such  training.  As  it  is,  the  data  trend  obtained, 
which  associates  a reduction  in  certain  instructional  components  of  the  trainer 
with  degraded  transfer  performance,  can  be  considered  as  only  minimally  suggestive 
of  the  benefits  that  might  be  derived  (and  are  expected)  from  such  features. 

At  present,  the  utility  of  dLveloping  CAT  materials  for  teaching  the  utiliza- 
tion of  the  AWfi-9  system  for  maintaining  the  F-.l  )i  aircraft  is  being  investigated 
for  the  continuation  of  researcli  in  this  program. 


ARTHUR  S.  BhAIWEG 
Gcientific  Officer 
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<J  SKCTION  1 


INTRODUCTION 


This  is  the  secoml  of  two  reports  describing  the  results  of  develop- 
ing and  field-testing  an  individual  trainer  for  the  Radar  Intercept 
Officer.  The  earlier  field  trial  was  a demonstration  of  the  feasibility 
of  using  an  intelligent  graphics  terminal  as  a standalone,  "CAI-system- 
in-a-terminal"  in  a fi(^' Id -training  environment  remote  from  access  to 
time-sharing  networks. 

In  the  research  to  be  described  here,  the  field  test  was  concerned  with 
evaluating  refinements  in  the  instructional  strategy,  and  with  the  instruc- 
tional value  of  several  computer  graphics  features.  These  differences 
between  Model  I and  Moilcl  II  of  the  trainer,  and  the  experimental  design, 
were  described  in  detail  in  ARPA  Quarterly  Technical  Report  for  July  1973. 
This  description  is  reviewed  below. 

Since  the  f/erformanre , assisting  the  pilot  in  air-to-air  intercepts, 
is  cjuite  complex,  the  trainer  also  is  complex.  Thus,  this  complexity  is 
necessary  even  tliough  the  trainer  >as  designed  to  teach  only  basic  skills 
used  in  this  performance.  Therefore,  the  details  of  the  instructional 
strategy,  and  of  tlie  dirfercntial  treatment  conditions,  require  rather 
complicated  descriptions.  (Icneral  requirements  for  a tIAI  system  of  this 
type  are  discussed  In  a companion  report.  The  present  study  is  one  in 
a series  of  studios  designed  to  provide  an  empirical  basis  for  deriving 
and  evaluating  these  general  requirements.  The  reader  is  referred  to  that 
report  for  information  about  the  GAI  system  architecture. 


*Rigney, 

e t a 1 . , 

1973. 

“Rlgney, 

et  al . , 

197‘'i. 
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M01)l':i,  II  Ol'  Till-;  KIO  TI'LA  l.NKR  AND  TIIK  I MI'.NTAI,  DKSICN 


Al)l)l':i)  TACTklAI,  I’UOCI'DIIKI'S 

I’os  i t ion  Ln^  Liu'  lij’Jitcr  tor  ;i  S i ilowi  luU'r  .'iLtafl;  ri.'C|ii  i.  ros  approxiniatoly 
a IhO  ili'yroe.s  Liiru  I rom  a heading,  iii'ar  lIio  15uj;(.'y  Hoad  i ii<>  Kaciprocal  Lo 
acli  iovo  a final  posiLioii  asti'rn  ol  lIu'  lioj>ay.  The  ji  roc  I'd  liras  for  acconi- 
pllshinji  tills  tactic  were  taup.lit  hy  (ha  Modal  1 traliiar. 

In  Modal  If,  till'  ]>roc('diiras  lor  l.ha  Sjiarrow  ittack  also  ara  taupht. 
ilia  Spariow  is  tlu'  1 irst  waapon  I iri'i.1,  while'  tha  i ii  Li’rcopLor  is  sti  1 L 
appioachinp  iiiul  in  1 rout  of  tlu'  hoj*,i'y.  I’lii’  1 iphli'c  must  ha  tiirncel  light- 
ly from  a collision  course  haadina,  to  .stahlish  a load  collision  course 
lor  tha  missih'.  Than,  tha  fij’.htar  must  ho  lavoK’d  for  lirinp.  Aftt'r 
fiiinp  the  Spiirrow,  tlu'  1 ipliter  iiiusf  ho  turnoil  s liplitly  apain  to  ontor  the 
rcattacU  turn  lor  tirinp  tlu’  S iilowindar.  Approximate  j’oometry  is  shown 
in  figure  1. 

Ilia  sttulont  KIO's  task  is  iiiailo  cons  idorah  I y more  dilficult  bv  the 
requireniont  to  iiuiko  hodi  missile  al  Lacks  .liirinp,  a problem,  lie  must  be 
able  to  astabl  ish  an  approach  that  wi  11  a I low  tlu’  necessary  maneuvi'rs  to 
be  made  in  quick  succession.  To  do  this,  he  must  develop  a high  mental 
informat  ion-process  ing  rata  and  he  must  ho  able  to  snift  his  altantion 
from  Sjiarrow  to  Sidowiinlor  attaik  ii'qiii  ramonts . This  is  a classic  example 
of  perlormanco  that  is  driven  by  a real-tim.'  problem.  I'ndar  these  condi- 
tions, the  davaloptiK-nt  of  fluency,  as  indicated  by  short  i csjionse- latencies 
and  low  error-rates,  is  essential. 

this  addl'd  tactii'  rt'qui.rt'il  scvi'ra  1 moil  i 1 icatiiins  tai  flu*  I’omputi  r jiro- 
gram;  for  scoring  tha  stuilent  s .Sjiarrow  atLai:k,  lor  jiro\  iding  a Sjiarrow 
fire  ili.sjilay,  anil  lor  recording  valiii's  ol  stuilent  ri'.sjionsa  variables  jier- 
taining  to  Llu'  .Sjiarrow  .atLack  jilia.se  ol  the  inti’rci'jiL.  The  jirincijial  new 
comjHi  ta  t ions  involved  wi'rc  lead  collision  conr.se  I’rror  for  tin-  Sjiarrow 
missile,  and  a score,  called  jirohab  i I i ty  ol  hit  (pllit). 

lo  .avoid  distracting  the  student,  graphic  and  numeric  scores  for  the 
Sjiarrow  ;ittack  wi-ri'  not  disjil.-iyad  until  he  linislu'd  the  le.attack  fSiiK'- 
windar)  jihasa  ol  tin  jirohlem.  The  lire  disjilays  for  the  two  missiles 
were  coinliined  in  one  lin.al  display.  This  lire  ilisjilay  presented  both 
graphic  anil  numeric  knowladjie  of  ri'siilts,  .-is  shown  in  lijuire  : 

a.  The  Sjiarrow  Disjilay.  lioj-,ev  and  fighter  jmsitions  and  haadinj;s  at 
time  of  firing,  .are  ilisjilayed.  The  dotted  lines  in  the  display  show  Llia 
f i r i ng- r.ing,i’  oni*.  Ihi’  diag.oii.al  line  show's  tlu*  li’.ul  i*ol  lision  cour.si*.  Tlu’ 
hit  jirohability  X 100  must  he  ' hO  lor  a p.as.siug,  score.  l,t;C  is  Lead 
Collision  Course  in  deg.rees . I'rror  dl.  r.ie.an:  fr.t:  was  2 degrees  too  far  left 
in  this  insl.-ince.  I'A  Id  means  t.arg.at  .asjiecl  w.’is  ! ')  dej'.rccs. 
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rlic  bogey  is  on  fixed  course  (BH)  and  speed.  The  fighLer  Lurns 
from  original  I’igliter  beading  (FH)  at  position  A to  a Collision 
Course  (CC)  . At  a short  range  of  8-9  nautical  miles  (B) , 'the 
fighter  turns  port  to  establish  a Lead  Collision  Course  (LCC) 
for  the  Sparrow  missile.  After  release  of  tlie  missile  and  prior 
to  6 nautical  miles  short  range  (C)  the  fighter  turns  port  to 
increase  his  displacement  disi.?nce  and  provide  turning  room  for 
the  Sidewinder  reattack  released  at  point  D. 


Figure  1.  Approximate  Geometry  of  Sparrow  Attack 
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b.  The  SicleWLiulc'r  Display.  Tlie  situation  at  the  time  for  firinj^ 
is  displayed.  The  Sidewinder  aequisiLion  cone,  the  bogey  heat  cone,  and 
the  firing  range  ;;one  are  shown.  for  a passing  score,  hit  probability 
X 100  must  - 80.  In  tliis  problem,  the  student  made  4 turns  after  turning 
to  collision  course,  took  173  seconds  to  complete  the  intereepL,  and 
turned  a total  of  100  degrees  in  liartl  as  possible  turns. 


c.  The  Simulated  11-Scan  with  the  Optimal  Path  (solid  line)  and  the 
Traek  History  (dotted  line)  superimposed.  The  dotted  circle  marks  the 
point  at  which  the  Sparrow  was  fired. 


ADDkD  INSTRUCTIONAL  I' KATURLS 


Moilel  1 instructional  features  wt>re  describc'd 
report.  They  are  sununar ized  below: 


in  ill 


tail  in  an  earlier 


Ins  Lruct  iona  1 feattire 

Static,  geographic  plot  of  fighter 
and  bogey 


Computational  error  knowledge  of 
results:  erroneous  value  disappc’ars 

from  toteboard,  arrow  does  not  move 

Correct  answer  for  intercept  triangle 
va  lue 

Sum  of  response  latencies  to  complete 
toteboard 

Free- fly  Mode:  Triangle  values 

provided,  dynamic  triangle  provided 

Knowledge  of  results  for  Sidewinder 
firing 


When  Displayed 

In  Static  Mode,  after  a computa- 
tional error  or,  on-demand  by 
student 

In  Static  and  Dynamic  Modes,  after 
entry  of  erroneous  value  by  student 


In  Static  and  Dynamic  Modes,  on- 
demand  by  student 

In  Static  and  Dynamic  Modes,  after 
entering  last  value  in  toteboard 

In  Dynamic  Mode,  if  score  for  Side- 
winder firing  was  < 80 

After  firing  Sidewinder 


The  above  features  were  continued  in  Moilil  II  of  the  trainer.  In  addi- 
tion, latencies  to  compute  each  intercept  triangle  value  were  displayed, 
for  more  detailed  knowledge  of  results  about  the  relative  difficulties  of 
these  computations.  An  end-of-problem  fire  display  for  the  Sparrow  missile 
was  added.  The  data  and  the  diagram  in  (a)  in  figure  2,  pertinen-  to  the 
Sparrow,  gave  the  student  knowleilgc'  of  results  of  his  Sparrow  attack. 

Two  new  graphic  features  in  Model  11  were  a bogey  track  history  and  an 
"optimal  path."  Roth  of  these  were  displayeil  on  the  11-scan  in  the  free- fly 
mode,  and  in  the  fire  illsplays  at  the  eiul  ol  a probli'm.  At  other  ti.mes, 
they  and  the  dynamic  triangle  wi*re  available'  to  the  student  through  a func- 
tion key.  The  bogey  track  history  and  the  optimal  path  were  designed  to 
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n.'isist  Llic'  kLikIc'ii(:  in  1 narn  i nj^*. . Iln  cmilcl  mancnivcT  llu'  fi)',litc-r  to  cauKc 
tlif  s iniii  I a Li'cl  rad.ir  rnHirn  (the  boj’oy)  Lo  movo  down  Liu'  15-scan  on  Llic 
"opLimal  patli"  I'or  boLli  Sparrovv/  anti  Sidewinder  attacks.  Tliese  di.splays 
■ arc  sltown  in  rigurcs  2 and  'J. 

Tlu'  dynamic  I riu'  plot,  Llic  bop,cy  track  bistory,  tbe  tiptimal  path,  anti 
tlic  Ciro-display  p.ctimctry  provitUal  visual  perceptual  information  to  Llie 
student.  I5y  comparing,  tlie  tlynainic  true  plot  ol  boj>ey  and  figiiter  positions, 
heatlings,  anti  movemt'iits  with  the  tlisplay  on  the  15-scan,  tbe  student  could 
be  assisted  in  learnin}>  to  interpret  this  relative  moLitin  tlisplay.  He 
must  learn  a spatial  frame  of  rcLerenct'  in  wbicb  the  15-scan  becomes  a 
window  on  the  v\/orld  fi.xed  to  the  nose  of  the  fighter,  and  all  motion  seen 
through  tills  window  is  relative  to  the  fighter's  position,  heading,  atti- 
tude, ant'  movement. 

I Tlu'  stutK'iit  could  super imiKisi'  the  bogey  track  history  on  the  optimal 

path  display  on  the  15-scan.  As  long,  as  he  kept  the  simulated  radar  blip 
on  or  very  near  the  optimal  path  line,  he  could  make  a good  Sidev^/inder 
intercept.  A Sparrow  Circ>  marker  appears  on  the  ojitimal  path,  but  the  stu- 
dent also  had  lo  remember  to  turn  slij-htly  and  to  level  out  before  firing. 
The  gra|ihtc  displays  of  situational  geometry  at  tbe  time  of  firing  each 
! missile  providi'd  cpii  ckl  y-g, rasped  in  fornuit  ion  that  the  stnileiit  could  use 

for  knowledge  of  results.  Ik'  could  see  iimned  iatel  y that  he  was  too  far 
away,  or  too  far  to  one  side,  or  turnetl  too  much  or  not  enough,  or  had  set 
up  the  wrong  lead  collision  course,  etc.  Me  could  use  this  information  to 
I modify  his  performance  on  the  next  p obleni. 

However,  in  the  lUO  trainer,  the  student  must  be  able  to  moot  criteria 
, of  proficiency  using  the  15-scan  alone,  without  the  presence  of  any  of 

I these  aids,  before  the  program  will  transition  him  to  the  next  level  of 

difficulty  or  will  allow  him  to  take  the  end-test.  When  the  stuoent  is 
i working  with  the  trainer,  most  of  the  time  ho  is  practicing  without  the 

' static  or  dynamic  triangle,  the  bogey  track  history,  or  the  optimal  path. 

The  presence  of  these  particular  stimulus  conilitions  is  not  essential  for 
correct  ros[)onding.  Tlu'se  features  are  only  instructional  aids  which 
' present  supplementary  information  for  the  standard  15-scan.  Therefore, 

they  would  be  expectetl  to  be  most  valuable  in  the  initial  stages  of  learn- 
ing, to  assist  the  sLudi-nt  in  understanding  relative  motion  on  the  15-scan. 

CH/\\'Gi;S  IN  Tin:  INSTKUCTIO.NAh  STRATKGY 

In  Model  I ol  the  trainei',  intercept  problems  were  groupeil  in  lour 
target  aspect  (TA)  ea Leg,or i es  . The  tria Is- to-cr  i ter i on  log,ic  ri'quired  the 
student  to  makc>  a passing,  score  on  four  succi'ssive  [iroblems,  one  from  each 
of  the  four  'I'A  catcg.ories.  kurl lu-rmore,  during  practice,  the  student 
cycled  throng, h tlu'  four  TA  categ.ories  in  each  successive  four  problems. 

The  ins  true  L i on.a  1 seipiL'iice  was  ihanged  in  Model  II  Lo  give  the  students 
more  concentrated  practice  in  each  targ.et  aspect  category,  ami  Lo  provide 
an  introductory  problem  for  each  TA  ealeg,ory.  Upon  entering  a new  'I'A 
c.ategory,  a student  was  first  g,iven  a problem  in  tlu'  free- fly  mode. 


h 
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Tlu-n  lie  workt'cl  pnicLicc'  prolilems  until  lit*  afliievocl  passinj’  scores  on  two 
successive  proi)lems.  lie  then  was  autonui  t teal  ly  traus  Ltioneil  to  tiie*  next 
TA  cati'p.ory.  There,  the  stiulent  repeated  the  same  seiiueuee. 

Also,  data  1 rom  tin-  I i rs  t lield  trial  indicali'il  that  the  orij;iual 
lour  tarji;et  aspi'ct  cate'j^ories  wi't*'  not  witlely  eiiouj^h  separated.  Accoidiiij;- 
ly,  only  three  TA  cr.  tej-ori  es , with  p,re‘ater  separation,  were  used  in  Mode- 1 
II. 


A second  modification  in  the  instructional  si.ratep.y  concerned  the 
time  alloteil  to  each  stiideiu.  In  Modi>l  I,  every  sLiuient  was  required  hy 
the  school  to  spend  tea  hours  on  the'  trainer.  It  tlu'  I r i als- to-cr  i te  rion 
loj’ic  transitioned  him  to  the  hij^hest  specvl  Ic'vel,  the  student  1 Lni.slu'd 
out  his  time  at  that  level.  In  Modi-I  11,  a student  spiuit  only  as  much 
time  as  \^^as  necessary  to  satisfy  the  trials-to-cri  terion  loj^ic  and  to  take 
a special  end-test  of  twenty  problems.  Thus,  each  stiulent  finished  the 
course  when  the  prop, ram  lop.ic  sai»l  lu‘  was  ready. 

The  end-ti'St  was  a third  modiliention  in  the  instructional  strategy. 
This  was  added,  because  we  wished  to  test  the  abilities  of  the  experimental 
and  the  control  groups  to  cope  with  unexpected  problems.  Unlike  those  in 
the  practice  session,  the  probli*ms  in  the  end-test  were  in  a random  sequence 
with  respect  to  target  aspect.  A student  could  not  predict  whether  the 
next  problem  would  be  a low,  medium,  or  high  target  aspect.  Also,  all 
test  probli'ius  were  run  at  “lOO  knots,  AO  knots  lasti'r  than  tlu'  highest  speed 
level  in  the  practice,  prohlems.  Tlu>  end-test  was  designed  to  be  a typo 
of  transfer  test. 

Other  modifications  ri'lated  to  the  static  triangle  (a  geographic  plot) 
and  the  Iree-fly  mode.  When  a student  started  on  the  trainer,  he  received 
three  sample  problems  in  the  lri‘e-fly  mode,  one  at  each  target  aspect  cate- 
gory. Then,  he  was  sequeueed  to  the  static  mode,  where  he  practiced  mental 
arithmetic  with  the  static  triang,le  visible.  Upon  solving  two  problems  in 
succession,  each  with  a total  latency  - 60  seconds  and  no  errors,  he  was 
transitioned  to  the  second  phase  ol  the  static  modi',  to  practice  without 
the  triangle. 

Till-;  KXrUKlMKNTAh  UKS  ICN 

A number  of  conditions,  each  of  which  could  serve  as  an  independent 
variable  in  more  rig,orously  controllable  laboratory  experimentation,  were 
lumped  together  in  this  field  trial.  Under  ideal  conditions,  a between- 
groups  factorial  desig.n  should  be  used,  with  an  independent  group  for  each 
combination  of  variables,  llmli'r  I ii*ld  conilitions,  wheic  the  rate  of  data 
collection  is  slow,  the  number  of  subjects  available  over  a period  ol  three 
to  six  months  is  limited,  and  the  evaluation  must  be  conducted  on  a "not 
to  interfere"  basis,  this  is  not  leasible. 

Students  in  the  first  field  trial  had  e-.pressed  strong  positive  atti- 
tudes toward  the  static  triangle,  the  dynamic  true  plot,  the  free-fly  mode, 
and  the  graphic  fin  displays,  as  being  heliiful  ins truct iona  1 features. 
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Tlicreforc,  Ct'nturcs  like  this  miglit  bo  considered  wnrlhwliile  iiierely  to 
increase  tlie  attractiveness  of  tlic  trainer  to  students.  However,  there 
would  remain  the  question  of  whether  these  features  increase  proficiency, 
as  measured  by  quantitative  criteria.  The  experimental  design  for  tlie 
field  trial  of  Model  il  was  planned  to  provide  some  information  about  this 
question,  in  terms  of  the  possible  advantages  of  trials  with  certain  of 
these  graphic  features  present  versus  "standard"  practice  trials  in  which 
these  features  were  absent.  The  measures  to  be  used  for  comparisons 
between  groups  were  numbers  of  problems  required  to  reach  transition  cri- 
teria at  various  stages,  errors  per  problem,  latencies  per  response  cate- 
gory, values  of  variables  measured  at  the  time  of  firing  each  missile, 
scores  on  the  end-of-course  test,  and  ratings  by  instructors  on  an  inflight 
checklist  used  in  two  inflight  training  phases. 


Two  versions  of  the  trainer  were  developed.  One  was  enriched  by  a 
particular  pattern  of  graphic  aids  and  one  was  not.  The  following  summarizes 
differences  between  graphic  features  in  the  enhanced  and  reduced  trainers: 


TABLE  1.  DIFFERENCES  BE-n%EEN  GRAPHIC  FEATURES  IN  THE  ENHANCED  AND  REDUCED  TRAINERS 
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’These  conscitucetd  tlie  exper inental  treatment  graphics. 
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SoMK'  o.\|)  l;mat  Lou  oC  Llio  s.Lnlic  mode,  dyiiumi.e  mode,  aiul  rree-fly  mode 
.1  Iso  is  iH'cessary.  I'lie  static  mode  is  "front- load  Liij',."  lieforc  a student 
was  i’i,v('n  a complete  intercei)L  problem,  lie  was  yiven  a period  of  drill 
in  compi.tiii)'.  the  six  values  for  the  intercept  trianpje:  hoj-ey  heading 

ree  i proca  1 , lar)>e(  aspect,  collision  e.nirse,  malauip  ang.le,  degrees  to  g.o, 
and  ang.le  oil.  Tliis  .Iri  1 1 was  ealle.l  ilu>  static  mode.  When  lu-  could  do 
all  six  ol  tlier.e  values  with  im  errors,  no  use  of  the  answer  ley,  and  with 
a total  latency  umler  hO  ::i'ioiuls,  on  t wo  succetasive  prohlc’ins,  he  was  auto- 
matically transitioned  to  the  .lynamic  mode.  In  this  moile,  the  remainder 
ol  the  intercept  prohlcmiwas  a.Ide.l;  the  student  still  liad  to  compute  the 
tahov'e  six  values,  hut  the  hogt'y  anil  I i, ’liter  were  now  moving  at  a predeter- 
mined speed.  As  soon  as  the  stndeiil  entered  tlie  value  of  collision  course, 
the  fighter  started  turning  to  tliat  value.  Hut,  since  the  lighter  had 
hes'ii  moving  I rom  the  start  of  the  problem,  the  student's  value  of  collision 
course  was  late  by  the  amount  ol  time  it  took  him  to  ilo  the  computations 
to  get  to  it. 

Three  introduciory  problems  in  tree-fly  mode  started  the  practice 
session,  tind  (*aeh  time  a tl  i I lerent  tarj’i’t  a.‘»pt'i't  cati‘g,iiry  was  entero’' 
the  first  problem  wa;;  in  free  I ly.  The  Iree-I  ly  miule  also  was  automatically 
entered  if  tlu'  student  did  not  achievi'  tlu'  scoring  criteria  for  the 
Sidi'windei,  pilit  - .>S0,  and  also,  aluive  UK)  knots,  lor  the  Sparrow,  pllit 
. )0.  I he  intent  ol  this  mode  was  to  g.ivi'  the  studi'iit  an  opportunity  for 
1 ri’c  practice,  during,  which  he  was  nnburdi  neil  ol  doing  mental  arithmetic, 
lie  had  the  ahove  gr.iphics,  in  the  enhanced  trainer,  which  he  could  relate 
to  tile  standard  11-scan.  It  was  calK’d  "iree-l  ly"  because  the  student  was 
free  of  the  hurden  ol  computing  triangle  values  and  was  free  to  "fly"  the 
I ighier  without  beiu;.*,  scoretl.  It  was  siippos.ed  to  hi’  an  opportunity  for  the 
student  to  relax,  and  to  Lake  stock  ol  what  he  had  doiu’  wrong,  in  the  preced- 
i ng  problem.  Ihis  modi'  was  supposi'il  to  ri’ihu'i'  a disadvantage  of  the  trials- 
lo-criterion  loj'.ic  lor  adajiting,  to  individual  diiierences;  students  are 
practicing  taking,  tlu’  Li'St"  all  t lu’  Lime  with  this  Kig,ic,  which  constrains 
the  learning,  |u'ocess  to  inti’iisive  practici'.  Ko  scoivs  or  other  ilata  were 
collected  when  a siiuleiil  was  in  free-fly  mode. 

It  wi  I I he  ii’iti  I led  that  ailaptive  coni  ro  I log.ii*  iic  usi*d  in  the  trainerj 
that  is,  each  student  prog.resses  at  his  own  rale  and  must  meet  successive 
t rans  i t ion  i ng  ci  itei  ia.  Ilu*  mori*  abli'  stuiUaits  \^i  1 1 work  Icwer  problems 
to  ^te  L Lhtoiig,h  to  Ilu*  end  than  the  less  ahli’  l uden  t.** . llo\^i*vi*r,  all  students 
started  with  the  same  problem  sei|ueiue  at  the  beg.inning,  of  each  different 
spis'd  level  and  target  aspecl  category. 

A iransii'c  i es I was  g,iv<  ii  lo  al  I sludi  iits  I rom  boi  h g, roups  when  they 
weiv  t ra  ns  i L i oiii'd  out  ol  the  Ion  speetl  li-vel.  Tin  hypothesis  was  that  those 
students  who  achiev’d  an  iinders  t and  i uj',  ol  the  true  and  relative  geometry 
involvinl  in  tlu’  inleriepL  laities,  i.e.,  wlio  liad  an  aeeuraii’  mental  picture 
to  g.uide  thi’in  would  do  hi'iii’v  on  I h<  transler  list.  The  eliaracteristics 
of  tlie  ni’Xl  piohlem  loming  up  in  the  t ran.s  1 1 r lest  wi’ri’  not  pri'ili  ctable 
friJin  ii’giilai  it  ii’S  in  problem  si’i|iieiu' i ng,  \vt  I'aili  now  prohli'iii  must  bo  "sizod- 
iip"  exLivmi'ly  rapidly  and  pe r I o rm;mi'e  imi:i  be  i.-.Lremely  llneiu  if  suceess- 
lul  ap.iirow  and  Ni’lewinder  al  taiks  are  to  be  laade  in  I he  sliort  time  available 
at  tile  inereased  transfer  speed  ol  did  I nols. 


I I 


NAVTRAEQUIPCl'N  73-C-0065-2 


I’ i ['.lire  ''i  sunuiKiri/'A's  tlio  dif  Cen-ncos  in  tlio  ins  true  L ional  sequence's 
for  the  two  j;r(»iips  used  in  the  experiment. 

I’ijUire  5 snmiiuir i zes  scoring  and  transitioning  criteria  used  throughout 
Llie  instructional  sequence. 
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SECTION  III 


DATA  COU.KCTION,  MATA  ANAIASKS,  AND  DISCUSSION 


DATA  COLLI'ICT'ION 


Tlu'  ck'Lails  ol’  tlu’  jirocculurcs  Llint  wore  ustil  in  lliLs  and  the  earlier 
field  trial  were  described  in  an  earlier  report  in  tills  scries. 1 Initial 
storage  limitations  (SK  of  cort>) . the  requirement  for  inexpensive 

recording  devices  with  relatively  high  reliability  di'termined  the  use  of 
these  procedure's . During  the  time  these  field  trials  were  being  run, 
inexpensive  floppy  disk  systems  became  available.  Thesi'  have  been  integrated 
with  other  inter f.'cing  hanlware,  so  that  all  data  recording  and  storage 
will  be  done  in  the  future  on  floppy  disks. 


The  data-col  lect  ion  was  iiuinaged  by  a Navy  Training  Device  Technician, 
in  general,  this  was  a feasible  arrangement.  ’I'he  ilata  were  received  from 
the  field  in  the  form  of  punched  paper  tapes.  While  each  student  was 
practicing  with  the  trainer,  a record  of  his  performance  was  punched  by  a 
teletype  (with  a silencer)  attached  to  the  terminal.  The  greatest  disad- 
vantage of  this  procedure  is  the  time  re<iuired  to  process  tapes  and  to 
produce  summary  statistics. 


Values  of  the  following  dependent  variables,  with  the  exception  of 
frequency  of  use  of  on-demand  kevs,  were  rocordeil  for  both  groups,  both  in 
practice  and  in  transfer  test  sessions: 


TAIlhf;  2.  DKl’UNDi’Nr  VAKUDLi:  blST 


COliNTKKS 

STATIC  VAK  lAliy.S 

DYNi\MlC  VARIABLES 

! 

i PROm.l-N  NUMhl-U 

TOfKIlOAKI)  TOTAI,  lATMNCY 

lATIcNCY  TO  CC  INPUT 

i STATIC  ATTI•;^n’TS 

TOri;ilO(\KI)  TOTAL  KRKOKS 

lATI-NCY  TO  FIRE,  SP  & SW 

STATIC  COW U:T IONS 

IISK  01’  TKIANCLK  KKY-’- 

NUMBER  OF  TURNS 

' DYNAMIC  ATTK.''U’rS 

HIT  PROIABILITY,  SW 

! DYNAMIC  COW U-T IONS 

HIT  I'ROIVMllLITY,  SP 

■ STATIC  AllOKTS 

LEAD  COLLISION  ANCLE  ERROR,  SP 

1 DYNAMIC  AllOKTS 

USE  OF  TRLXNCLE  KEY-- 

1 

rSI.  OF  rOTEBOARD  KEY* 

1 

1 

L. 

INFLICHT  CHECKLIST 

■■'■I'ixperimc'ntal  group  only.  In  .iddition,  an  attitude  (lues  t i onna  ire  and  comment 
sheet  was  completed  by  each  stmli-nl  .at  the  end  of  the  session  with  the 
tra iner . 
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OATA  ANAI.YSKS 


liio  valiu’S  ol  riu'  above  variables  wore  used  in  lIu-  analyses.  Inter- 
med.au.  .^annn.a  r , es  eons  i s t i nf>  ni  smm.s.  sums  of  squares,  and  K"s  were  listed 
in  Ll.e  sLanstieal  proj.,r.i.n  lor  visual  inspeetion  Sui,se.,uent  analyses 
were  done  nrmually,  usinj;  appro, >riate  eategories  ol  these  data.  This 
method  o sunnnary  and  analysis  is  leasible  with  relatively  snutll  samples 

nii-  T ^i^vanta,,e  ol  allowing  visual  inspection  of  inter- 

c ha  o-level  summaries  to  cheek  lor  errors  and  to  identify  additional 
ways  to  organ Lxe  tlu>  ila ta . 

Ilaiil  coiiy  listings  ol  the  intermediate  summaries,  Cor  each  stuilent 
foi  each  elass,  and  tor  each  oL  tlu-  two  groups  in  the  field  trial  were  ’ 

space  'l'"  [''•'‘•I'"" - "owever,  in  the  interests  of  saving 

space,  all  oi  these  data  will  not  be  reproduced  here. 


ItM-  AltUVSB.  U „m  l„.  ,ocall..<l  that  tlu-  ,.n,l-ot-co.,„t.  tr, ■,,»£„ 
trst  „as  doa,8„f<i  t„  ptosont  tlif  at,Kl,.„ts  In  ..a.I,  „t  il,..  tvo  crpup.s  with 
unpredtttahlc  «t.xturo  „C  (20)  nit  intorcopt  pt„bl,.,,s,  nt  „ Rtoitor  .llffi- 
y fvel,  as  determined  by  40  knots  higher  s,ieed  (500  knots).  The 
o jee  ive  was  to  test  the  students'  ability  to  cope  with  unexpected  varia- 
tions in  initial  problem  conditions:  Initial  positions,  headings  and  ranges 

of  Che  bogey;  and  widely  varying  initial  target  as|H-cts  between  bogey  and^ 
mndonwirdei!  students  took  the  same  twenty  problems,  but  in  diffei-ent 

sli.bM.^'  table  -5  ihat  the  enhanced  group  did  verv 

out  of  ^0  "'■in?  •'^tgnificant)  on  number  of  problems  correct 

oit  ol  ^0,  and  on  both  missile  (S,)arrow  and  Sidewinder)  scores.  Some 

explanation  ol  tlu'  variables  listed  in  table  d is  in  order. 

"Static  problems" refers  to  the  first  ,iart  of  an  intercept  problem  in 
wiich  the  student  ninst  mentally  compute  values  of  six  variables  for  the 

Corti?'^"  this  within  60  s,.conds  and  without  erro- 

Lor  the  iiroblem  to  be  scored  correct.  In  the  transi.er  test,  the  student 

had  to  go  on  and  complete  the  intercept  even  though  he  might  not  achieve 
lese  criteria.  11  he  iicide  an  error  in  arithinelic,  the  remainder  of  the 
intercept  was  scored  uicorrect.  If  he  made  no  errors,  but  did  not  finish 

reet  h‘T  r , the  "static  problem"  was  scored  incor- 

e t,  but  be  could  go  on  to  achieve  a correct  score  on  the  subsequent 
(dynamic)  ,iart  ol  the  problem.  There,  a pilit  score  .50  was  required  for 
be  ^Parrow  missile  at  all  speed  levels  above  JOO  knots,  and  a ,)||it  score 

part  o"f  ^ 1-vels,  for  the  subsequent 

p.  rt  of  the  problem  to  be  scored  correct.  The  two  missile  firing  scores 

were  set  at  diifereiit  cutolfs  because  of  the  differences  in  relaUve  diffi- 
culty as  judged  by  an  ex,,er ieiiced  aviator,  in  making  these  attacks  for 
example,  due  to  the  high  closing  rate  of  the  H,, arrow  attack  ap,, roach  tactic 

fignrer/Tnd  2):’*^"  ’ 


I.atencies  to  finish  certain  parts  of  the  problem  were  recorded  in 
seconds.  Number  ol  turns  included  the  turn  to  collision  course  and  all 
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siibsc'ciiu'iiL  turns-.  The  roquirenicnt  to  Lire  a Sparrow  at 
300  knots  up  acklecl  to  the  number  of  necessary  turns. 


speed  levels  from 


I 


l>lb\t:Tia;  session  data  analyses.  The  sequencing  logic  for  the  practice 
problems  was  described  in  figure  4.  Ikisically,  students  in  both  groups 
had  to  continue  practicing  until  they  achieved  the  transitioning  criteria 
for  tliat  mode  (Static  of  Dynamic')  or  (speed)  level.  Tliey  then  were  auto- 
iiuitically  transitioned  to  the  next  mode  or  level.  As  explained  above,  the 
"enlianced  group"  was  exposed  to  several  graphic  instructional  aids  during 
introductory  sample  problems,  the  first  stage  of  the  static  mode,  when 
they  made  computational  errors,  and  while  they  were  repeating  entire  inter- 
cept problems  tliat  they  did  not  "pass"  the  first  time  and  any  other  time 
on  demand.  Analyses  of  data  recorded  during  the  practice  sessions  are 
sunimari/ed  in  fables  4-Jd. 


ErtquencLes  of  various  events  are  summarized  in  table  4.  Some  of  the 
variables  require  some  explanation.  Again,  number  of  static  problems 
correct  refers  to  computations  of  Llie  values  for  tlie  six  triangle  variables 
in  both  the  speciiil  static  mode  and  in  the  subseqiu-nt  dynamic  mode.  Number 
of  dynamic  problems  attempted  includes  the  last  part  of  all  problems  after 
the  static  mode.  Proportion  of  problems  repcateti  refers  to  the  fact  that, 
if  scoring  criteria  were  not  achieved  on  the  dynamic  part  of  a problem, 
that  problem  was  automatically  presented  in  the  free-fly  mode.  For  students 
using  the  reduced  trainer,  this  meant  flying  the  problem  again  without 
having  to  compute  intercept  triangle  variables,  but  with  none  of  the  other 
graphic  aids.  For  students  using  the  enhanced  trainer,  the  problem  was 
repeated,  too.  but  in  this  case,  the  dynamic  triangle,  the  optimal  path, 
and  the  bogey  track  history  wore  present  throughout  the  problem.  Propor- 
tion of  problems  aborted  refers  to  those  cases  in  which  a student  \ias  inter- 
rupted during  a problem,  or  ho  hit  the  missile  firing  key  before  64  seconds 
into  the  problem. 


It  is  noteworthy  that  students  in  both  groups  aborted  a mucli  higher 
proportion  of  repeated  problems  (.12  and  .10)  than  they  did  new  problems 
(.03  and  .02).  Recall  chat  the  students  knew  they  were 
on  repeated  problems,  which  were  in  Che  free-fly  mode, 
felt  that  they  had  extracted  enough  information  at  some 
tion  and  decided  to  terminate  tlie  practice,  or  they  did 
the  problems  at  all. 


not  being  scored 
Evidently  they  often 
point  in  the  repeti- 
not  want  to  repeat 


It  is  apparent  from  the  data  in  table  4 that  tlic*  students  using  the 
reduced  trainer  took  fewer  jiractice  problems  and  achieved  final  transition- 
ing criteriii  in  I'ewer  on-line  sessions  than  was  the  case  for  students  in 
the  other  group. 


Also,  students  in  tin-  enhanced  group  generally  did  slightly  worse 
than  the  other  group  in  terms  of  proportions  of  problems  attempted  that 
met  scoring  criteria,  i.e.,  that  were  scor  d as  eorrecl.  It  should  be 
rei-alled  that  the  transitioning  criteria  added  to  the  scoring  criteria  the 
requirement  to  successfully  complete  pr'iblems  in  succession  in  order 

to  transition  to  the  next  speeil  level,  or  at  the  end,  to  transition  to  the 
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transCor  test.  In  table  A,  numliei-  of  problems  correct  is  based  on  scor- 
Lny  criteria.  It  will  be  seen  later,  in  table  12,  tliat  students  in  the 
enlianced  group  liad  a sliglitly  liigber  error  rate  on  tbe  toteboard,  tbrougli- 
uut  all  practice  conditions.  If  a student  made  a toteboard  error  during 
tlie  dynamic  pliase  of  practice  (220  tlirough  460  kt)  , lie  was  allowed  to 
finisli  tlic  intercept,  and  liis  turns  and  missile  firing  scores  were  included 
in  tlic  data,  but,  tlie  problem  wa.s  counted  as  incorrect.  Under  these 
conditions,  tlie  higlier  toteboard  error  rate  of  the  enlianced  group  could  have 
required  this  group  to  attempt  more  problems,  even  though  their  proficiency 
scores,  turns  and  missile  pllit  scores  were  as  good  as  the  other  group  s. 

Tbe  comparative  analyses  of  elapsed  times  for  various  events  are 
summarized  in  table  1. 

The  various  response  latencies;  to  complete  the  toteboard  (mentally 
compute  six  values  for  the  intercept  triangle),  to  fire  the  Sparrow,  and 
to  fire  the  Sidewinder,  are  elapsed  times,  in  seconds,  from  the  beginning 
of  a problem  until  a student  achieved  these  conditions. 

These  latencies  arc  means  computed  over  all  problems,  over  the  static 
and  dynamic  modes,  and  over  all  seven  speed  levels.  Thus,  they  might  be 
regarded  as  summary  fluency  scores  for  each  group. 


It  is  apparent,  from  the  data  in  table  5,  that  the  enhanced  group  re- 
quired an  average  of  2.15  liours  longer  to  achieve  final  transitioning  criter- 
ia (460  knot  level)  than  did  the  reduced  group  (12.51  hours  vs  10.36  hours). 
Means  and  standard  deviations  of  tlicse  values  in  hours  arc  total  elapsed 
times  students  spent  on  the  trainers,  as  recorded  manually  in  a log.  Thus, 
tlicse  times  are  not  as  accurate  as  those  in  remainder  of  the  table,  which 
were  automatically  recorded  in  minutes,  or  seconds,  by  the  computer  program. 
Differences  between  response  latencies  to  complete  major  parts  of  a prob- 
lem were  very  siiull,  with  the  reduced  group  being  a few  seconds  quicker, 
over  all. 

Tile  summary  statistics  in  table  6 arc  overall  values  of  various  indi- 
cators of  accuracy  of  performance.  The  probability  of  hit  scores  for 
firing  the  two  missile.s  have  been  described  above.  The  algorithms  for 
computing  these  scores  take  basic  parameters  into  account,  as  diagrammed 
in  figure  2.  because  firing  the  Sparrow  accurately  is  a much  more  difficult 
problem  for  the  student  RTO  than  firing  the  Sidewinder,  the  cutoff  score 
was  set  much  lower  (.Sparrow,  pllit  = .50;  Sidewinder,  pllit  = .80). 

The  lead  ^’ollision  course  error  refers  to  the  error  in  leading  the 
bogey  when  "aiming"  the  Sparrow.  The  absolute  error  is  presented  in  the 
table.  Leading  too  much  or  too  little  is  not  differentiated  here,  although 
it  could  be  of  tutorial  importance  to  do  so. 

Number  of  turns  during  intercept,  like  all  the  measures  in  these  tables, 
is  a summary  mean  over  all  speed  levels  and  target  aspect  angles.  It  is  a 
measure  of  the  precision  with  which  the  student  could  fly  the  inter- 
ceptor under  all  these  varying  conditions.  It  includes  the  initial  turn 
to  collision  course,  and  in  this  respect  differs  from  the  measures  of  the 
same  variable  reported  for  the  earlier  field  trial  of  this  trainer. 
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Errors  in  comph-Ling  tlie  totoboard  concerns  tlie  Ercqucmcy  of  errors 
students  made  in  computing  and  entering  values  of  the  six  intercept 
"triangle"  variable's.  Tlie  Crequency  of  these  errors  did  diminish  with 
practice,  but  some  students  in  botli  groups  eontimieil  making  an  occasional 
I'rror  throughout  tlu'  training.  It  was  our  experii'uce  in  the  earliir 
lield  trial  that  iinny  of  tliese  errors  were  due  to  the  inability  to  tell 
left  I rom  rig.ht  instead  of  to  computational  failures. 

Tlie  most  obvious  conclusion  to  be  drawn  from  insjiection  of  table  6 is 
that  tlie  two  groups  were  very  similar  to  each  other  in  terms  of  these 
overall  proficiency  mi'asures.  T'he  enhanced  group  iliil  make  more  toteboard 
errors  as  indicated  by  the  means.  It  will  be  seen  that  the  distribution 
of  these  errors,  shown  later  in  table  12,  is  of  importance  for  explaining 
the  results. 


TRENDS  ACROSS  SUCCliSS  1 VC  IMlACTICK  tiONDITlONS 

Strong  evidence  for  the  effectiveness  ot  the  trainer  as  a device  for 
teaching  basic  skills  was  preseiiti'd  in  the  report  of  the  first  field  trial. ^ 
Similar  evidence  is  available  from  the  current  field  evaluation.  Pertinent 
tables  are  presented  below.  In  all  cases,  the  trends  across  the  tables, 
from  left  to  right,  reveal  the  effects  of  practice,  on  low,  medium,  and 
high  target  aspect  problems,  driven  by  increasingly  higher  problem  speeds, 
from  22(1  to  4(i0  knots.  In  some  eases,  lower  and  upper  bounds  of  response 
latencies  are  influenced  by  the  speed  of  the  jiroblem.  However,  in  the 
case  of  the  mental  computations  of  values  of  the  six  intercept  triangle 
variables,  it  is  always  to  the  advantage  of  the  student  to  get  this  mental 
chore  done  us  quickly  as  possibU',  to  avoitl  getting  behind  the  problem. 

Table  7 presents  total  latencies  to  complete  the  toteboard,  for  all 
the  values  ot  the  six  variables.  As  in  the  previous  field  evaluation, 
there  was  a nuarked  reduction  in  means  and  variances  between  first  and  last 
practice  conditions.  Over  all  target  aspect  categories  (bottom  row),  the 
mean  latency  was  reduced  by  a factor  of  2.30,  the  standard  deviation  by  a 
factor  of  1.22. 
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TABLt;  7.  OVKRALL  lATKNCY  (SEC)  (MIANS 
AND  VARIANCES)  TO  COMPLETE  THE  TOTEUOAKD 
AS  A CONSEQUENCE  OF  PRACTICE  (N  = 60) 


TARGET 

ASPECT 

STATIC 
[ II 

220 

260 

DYNAMIC 

300 

LI-A/ELS: 

340 

SPEED 

380 

420 

460 

RW 

TOTAL 

M 

SD 

70.74 
64 . 66 

39.33 

22.32 

50.45 

31.21 

37.64 

16.11 

36.02 

22.73 

30 . 32 
11.14 

26.03 

9.30 

27.37 

17.54 

24.90 

10.17 

41.71 

36.26 

MED 

M 

SD 

61.32 

32.71 

51.22 

26.60 

49.33 

28.34 

44 . 34 
18.76 

37.32 

17.80 

32.88 

12.30 

36.18 

18.25 

32.52 

15.94 

28.33 

9.40 

41.64 

23.77 

HIGH 

H 

SD 

57.30 

28.49 

61.25 

35.21 

56.69 

37.22 

49.36 

23.31 

40.04 

18.66 

35.66 

17.08 

35.38 

16.33 

34.91 

10.97 

36.29 

21.05 

44.07 

25.74 

COLS 

TOT 

M 

SD 

67.96 

49.00 

51.29 
30 . 14 

5?-16 

32.45 

44.12 
20 . 34 

37.54 

20.32 

33.  10 
14.02 

33.14 

16.07 

31.98 

14.94 

29.51 

15.22 

42.49 

29.39 

J 
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Tlio  riso  in  tills  latency  at  the  220  knot  level  imllcates  the  student's 
first  experience  with  the  h-scan  and  the  requirenuMit  to  keep  up  with  the 
problem.  The  hi};hest  tar}p:L  aspect  problems  (second  row  from  the  bottom) 
evidently  presenteil  the  most  difficult  computations,  possibly  because 
some  of  Llu>  numbers  involvi'd  weri‘  larger. 

We  see  similar  trends  in  the  data  in  table  H,  where  frequency  of  tote- 
board  errors  is  summarized.  Stin’ents  tended  to  nuike  more  errors  in  high 
targe t -as pec L problems . 

Scores  for  firing  missiles  obviously  would  he  influenced  by  increasing 
thi“  speetl  of  the  intercept  problem.  It  becomes  more*  aiul  more  dilficult 
for  the  student  to  get  his  aircraft  into  correct  position  for  firing 
before  it  is  too  late.  Nevi'rtheless , the  pilit  scc.ri’S  lor  firing  the 
gp^j^^QW  and  the  Sidciwinder , as  shown  in  tables  9 and  Ihj  do  indicate  some 
improvement,  in  most  cases,  despite  the'  increasing  speeils. 


TAlUdi  8.  WHRAhl.  KKRORS  IN  COMPLETING 
TOTKIUlAKll,  ACROSS  SUCCESSIVE  PUACTICK 
CONDITIONS  (N  = 60) 


TARGET 

ASPECT 

STATIC 
T 1 1 

220 

DYNAMIC  LEVELS: 
260  300  360 

SPEED 

380 

620 

660 

ROW 

TOTAL 

■ 

M 

0.D2 

O.'i-'t 

0.70 

0.61 

0.66 

0.27 

0.21 

0.21 

0.33 

0.50 

[.OW 

SO 

1.66 

1.20 

1.66 

0.88 

1.25 

0.86 

0.33 

0.80 

1.21 

1.27 

M 

0.81 

0.36 

0.33 

0.56 

0.66 

0.26 

0.30 

0.35 

0.31 

0.50 

dED 

SI) 

1.37 

1 .()A 

1.13 

1 .00 

1.06 

0.72 

1.77 

1.20 

0.83 

1.19 

M 

0.73 

0.77 

0.70 

0.62 

0.60 

0.67 

0.65 

0.33 

0.51 

0.56 

IIGII 

SI) 

1 .26 

1.33 

1.62 

1.10 

0.87 

1.26 

1.62 

0 . 03 

1.26 

1.26 
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TARGET 

ASPECT  220 

DYNiVMIC 
260  300 

LEV  i:  US: 
3AO 

SPEED 

380 

A20 

A 60 

ROW 

TOTAL 

M 

56.07 

58.27 

65.13 

60.11 

60. 9A 

59.95 

l.OW 

SD 

AO.  70 

AO. 32 

37.76 

38. 9A 

A0.A2 

39.77 

M 

6‘J.DS 

68.5  7 

63.91 

61.79 

71.09 

66 . 96 

MED 

SD 

33.85 

32 . 90 

36.38 

36.9‘» 

31.96 

34.63 

M 

66 . % 

58.65 

59.53 

53.36 

56.89 

58.61 

HIGH 

SD 

3A.25 

AO.  01 

39.30 

A 1.82 

AO.  13 

39.59 

COl. 

M 

63. A9 

62.17 

62.65 

57.87 

62.59 

61.70 

TOT 

SD 

37.30 

37.91 

37.88 

39.70 

38.45 

38.33 

tabu;  10.  TUHNDS  IN  SlDllW  INDF.R  P-llIT  SCORIA  (MIIANS  AND  VARIANCES) 
ACROSS  SUCCESSIVE  PRACTICE  CONDITIONS,  (N  = 60) 


TARGET 

ASPECT 

220 

260 

dynamic 

300 

LEVELS : 
34  0 

SPEED 

380 

A20 

460 

ROW 

TOTAL 

LW 

M 

SD 

7A.I7 
AO. 68 

88.22 

29.99 

88. 13 
30 . 16 

90.13 

28.33 

90.63 
26 . 99 

87.35 

31.03 

88.33 

29.45 

MED 

M 

SI) 

81.90 

36.05 

93.56 

21.80 

93.72 

21.38 

93.35 

22.87 

88.13 

29.58 

92.50 
24 . 30 

95.38 

18.71 

91.06 

26.10 

HIGH 

M 

SI) 

86.  A8 
31.21 

89.35 

29.10 

94 . 75 
18.90 

91.91 

25.24 

84. 3A 
34 . 88 

92 . 1 3 
25.26 

91.57 
24 . 72 

89.90 

27.93 

COL 

TOT’ 

M 

SD 

79.90 

37.16 

90.46 

27.16 

91.69 
24 . 96 

91.91 

25.37 

87.28 

31.23 

90.82 

26.89 

91.33 

25.44 

88.88 

29.12 

; I ^ 
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It  slioulil  1),'  noLc'cl  tliat  students  could  fire  tlie  S|);irrow  below  300 
knots,  and  a tew  iliil  tliis,  but  to  be  consistent  witli  operatitinal  pro- 
cedures tlu'  program  ilid  not  count  tlicse  scores  toward  transitioning  to 
tlie  nest  level.  I’-lliL  scores  for  firing  tlio  Sparrow  decreased  from  300 
to  AGO  knots  lor  tlu'  liigli  target  aspect  problems,  again  an  indication 
tliat  tills  was  tlie  most  difficult  of  the  three  target  aspect  categories. 

The  high  target  aspect  category  evidently  was  not  markedly  more 
diflicult  than  the  low  and  medium  categories,  in  the  case  of  the  Side- 
winder, despite  the  increasing  speeds.  There  was  a steady  improvement 
in  scores  across  the  successive  speed  conditions. 

The  tremls  in  number  of  turns  are  shown  in  table  11.  Tlu'  biggest 
improvement  occurred  for  low  target  aspect  problems.  These  low  target 
aspect  problems  also  were  the  first  to  occur  at  220  knots  in  the  instruc- 
tional sequence.  These  trends  corroborate  the  eviilcnce  in  the  preceding 
tables  for  the  effectiveness  of  the  trainer. 


TABI.i;  11.  Ml-IANS  AND  VAKIANCKS  FOR  NUMBER 
OF  TURNS  USF.D  TO  HAKE  AN  INTERCEPT  ACROSS 
SUCCESSIVE  PRACTICE  CONDITIONS  (N  = 60) 
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COMI'AIUSON  01’  TKllNDS  I’.K'nv’HKN  OKOIIPS 

IL  is  importanL  Lo  examine  trends  in  each  proup,  to  identity  any 
diiierences  between  groups  that  miglit  be  attributable  to  difterenccs  in 
treatment.  Table  12  summarizes  tliis  information.  There  are  very  few 
differences  between  the  two  groups  with  respect  to  turns  and  pllit  scores, 
in  terms  of  trends  across  practice  conditions.  The  enlianced  group  did 
attempt  a few  more  problems  in  every  practice  comlition,  yet  tlieir  scores 
on  tli'j  above  proficieney  measures  were  approximately  equivalent  to  tlic 
(jtlier  group.  Tliese  data  also  reveal  noteworthy  differences  between  the 
two  groups  in  terms  of  computational  errors  in  computing  intercept  triangle 
values,  in  tlie  static  mode  and  at  most  of  the  speed  levels.  The  overall 
mean  for  tl\e  enluinced  group  was  .57  (SI)  = 1.32)  versus  ,44  (SI)  = 1.13)  fei 
tlie  reduced  group  (Table  6).  Tl\e  significance  of  this  is  as  folle\v/s. 

During  tlie  static  phase,  the  display  of  the  static  triangle  may  have  been 
distracting  iluring  the  performance  of  mental  arithmetic.  During  the  dynamic 
phase  of  the  practice,  220  through  460  knots,  it  will  be  recalled  that 
students  still  had  to  compute  intcM'cc'pt  triangle  v;ilues.  Ihen,  they  went 
on  to  "fly"  the  intercept,  in  the  second  part  of  the  problem.  If  they 
had  made  a computational  error,  they  were  allowed  to  finish  the  intercept, 
and  their  proficiency  scores  (number  of  turns,  missile  firing  scores) 
were  included  in  the  data.  However,  the  problem  was  ncU  counted  toward 
transitioning  to  the  next  TA  category  or  next  speed  level.  Nor,  was  the 
problem  repeated  in  free  fly>  nor  was  it  counted  as  correct.  Therefore, 
this  slightly  higher  error  rate  in  the  enhanced  group  could  have  been  a 
major  reason  for  this  group  having  to  do  more  practice  problems  and  to 
take  more  time  in  the  practice  session,  oven  though  the  proficiency  scores 
of  the  two  groups  wore  almost  identical  at  all  practice  stages. 

The  latencies  to  complete  the  toteboard,  in  table  12,  also  are  note- 
worthy. The  enhanced  group  was  mucli  slower  in  tlie  first  and  second  parts 
of  the  static  phase;  74.25  sec  vs  58.91  sec  and  55.72  sec  vs  46.01  sec. 

A possible  explanation  for  this  is  again,  that  the  geometric  display  of 
the  static  triangle  was  actually  distracting,  so  far  as  the  mental  arith- 
metic task  was  concerned. 
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TAULH  12.  C(WAK ISONS  HKWKI-N  KNIIANCKD  (!•)  ANU  RKDIICI' 1)  (R)  GROUPS 
WITH  RHSPRCT  TO  TRRNDS  IN  SUCGRSS tVK  PRAGTIGR  CONDITIONS 
(AVF.RAGRD  ACROSS  TARGKT  ASPRCT  CATFGORIRS) 


STATIC 


SPKKD  I.KVm.S:  DYNAMIC  PllASF 


260  300  340  380  420 


UTFNCY  TO 
DO  TOTRDOAKD 


COmniTAT  lONAl  R 
FRRORS  IN 
TOTl-UOARD  on 


TOTAL  NUM15KR 
OF  TURNS 


1.78  1.33  1 

2.02  l.')3  1 


SPARROW 
PlllT  SCORi; 


63.29  61, 

63.74  63. 

37.16  38. 

37.64  37. 


SIUraiNDKR 
PlllT  SCORi; 


STATIC  PRODS 
A 3TF  Ml^TFD ' 


COm’LRTFD^ 
DYNAMIC  PRODS 
ATTKIQ’TRD^ 


COMl’LKTi:i/' 


(MMAN  NO.  OF  PRODLFMS  PF.R  STUDKNT) 


20.93  12.80  19.06  13.97  18.13  18.32  20.29  15.45  15.64 

13.38  11.18  15.10  10.38  14.86  13.63  14.00  17.93  13.37 

8.26  7.45  10.32  8.84  13.13  14.35  15.52  12.84  12.35 

8.27  7.48  8.76  7.07  11.10  10.69  10.96  14.65  10.37 

18.42  13.87  16.97  17.77  19.77  15.03  15.35 

14.89  10.31  14.07  13.43  13.86  17.45  13.10 


I’otuls  AtLumptocl 

“ To  La  Is  Comp Ic  toil 

To  La  l.s  A 1 1:  ompLod 

Totals  Completed 

1-:  = 4793 

i;  = 3207 

i;  = 36  33 

E = 1791 

R = 3662 

R = 2595 

R = 2817 

R = 1576 

ll*J 
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STUDI'INT  ATTITl'DI':  (,Hn:ST  I ONNA  IklvS 

l''ssential ly  tlac*  same  questionnaire  was  used  in  Lliis  study,  as  \;as 
used  in  tlie  first  field  stutly,  with  the  exception  of  several  questions 
not  applicable  for  the  reduced  group.  The  results  of  questions  common  to 
botli  groups  are  reproduced  in  table  13.  It  will  be  recalled  that  this 
was  a forced-choice  instrument  witli  two  positive,  one  neutral,  and  two 
negative  categories  for  each  item.  There  were  ten  items  common  to  both 
groups.  Since  only  25  out  of  the  29  students  in  tlie  reduced  group  res- 
ponded to  the  que.  tionnaire,  versus  all  31  students  in  the  enhanced  group, 
proportions  instead  of  frequencies  are  given  in  the  following  tables 
(13,  14,  and  15). 

It  is  apparent  from  an  examination  of  table  13  that  both  groups  liail 
generally  favorabli'  attitudes  toward  the  trainer,  as  sampled  by  these 
questions.  However,  there  were  more  extremes  in  attitudes  among  the 
reduced  group.  'I'liese  differences  are  shown  in  table  14. 

In  adtlition  to  tlie  items  comnuin  to  both  [groups,  five  items  on  the 
questionnaire  were  specific  to  the  free-fly  mode,  in  which  the  special 
graphics  described  above  were  available  only  to  the  enhanced  group.  The 
responses  to  these  items  arc  tabulated  in  table  15.  In  addition,  one 
questionnaire  item  required  a yes  - no  response: 

"In  free  fly  you  could  observe  the  relationsiiips  bc'tween  intercept 
geometry  and  radar  presentation  during  an  intercept.  Did  you  use  this 
feature?"  Of  the  31  students,  25  responded  yes  and  six  responded  no, 

Tliese  data  indicate  a pri'ponderance  of  favorable  attitudes  toward  this 
feature  of  tlie  trainer.  (Kolmogorov-Smirnov  one-sample  test:  p<.01). 


The  attituile  questionnaires  used  with  the  two  samples  are  reproduced 
in  Appendix  A. 


UIOGRAPIIK’Ab  DATA 

Certain  items  of  backgroumi  information  were  collected  from  the  stu- 
dents. Althougli  not  all  students  supplied  every  item  requesteil,  scores  on 
standardized  tests  and  prior  courses  in  the  Navy  wi*re  available  from  the 
Naval  Aerospace  Medical  Research  haboratory,  Pensacola.  These  ilata  are 
summarized  in  tables  16  and  17.  It  is  apparent  that  there  were  no  signifi- 
cant differences  in  the  ilata  for  tlie  two  groups. 

INrUCllT  CIIKCKI.IST  DATA 

The  checklist  ileviseil  for  use  by  instructors  during  field  testing  of 
Model  i was  revised  to  make  it  simpler  for  the  instructors  to  use.  A copy 
is  reproduced  in  Appendix  II.  The  data  from  these  cliecklists,  which  were 
used  cli'vcn  times  on  each  student,  five  duriiig.  Initial  flight  training 
(RT-8)  and  six  during,  more  advanced  flight  training.  (KT-13),  were  converted 


30 


NAVTRAEQUIPCEN  73-C-0065-2 


TABLE  14.  Dri’FERENCES  IN  MEANS  OF  PROPORTIONS  OF  SAMPLES 
EXPRESSING  ATTITUDES  TOWARD  THE  TRAINI'IR 


ENHANCED  GROUP 
REDUCED  GROUP 
DIFFERENCES 


.361 
.256 
+ .105 


.027 

.080 

-.053 


TABLE  15.  ATTITUDES  OF  STUDENTS  TOWARD  THE  FREE  FLY  MODE 
IN  THE  TRAINER  (CELL  VALUES  ARE  PROPORTIONS  OF  SAMPLE) 

(N  = 31) 


RESPONSE  CATEGORY 

10 

12 

ITEM  NUMBER 
13 

14 

15 

MEANS 

VERY  FAVORABLE 

.35 

.29 

.23 

.23 

.13 

.246 

FAVORABLE 

.42 

.45 

.32 

.52 

.32 

.406 

NEUTRAL 

.19 

.19 

.39 

.16 

.45 

.276 

UNFAVORABLE 

.03 

.03 

.03 

.03 

.10 

.044 

VERY  UNFAVORABLE 

.00 

.03 

.03 

.06 

.00 

.024 

(Kolmogorov-Smirnov  Or.p-Sample  Test  of  Means:  p =<.01) 
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TAliLI';  16.  BIOGRAPHICAL  DATA  FOR  THE  GROUP  USING 
THE  KNIANCED  TRAINER:  APTITUDE  TESTS 

AND  PKI'XIEDING  NAVAL  TRAINING  COURSE  SCORES 


N 


32 


i 


STUDENT 

VT-10 

VT-10 

NUMBERS 

AE(ri' 

EAR 

ACADEMIC 

PRACTICAL 

1 

1 

6 

7 

4 7.82 

3.05 

2 

6 

9 

53.40 

3.13 

3 

5 

3 

50.10 

3.00 

4 

8 

5 

61.76 

3.27 

5 

5 

3 

5 7.48 

3.00 

6 

5 

7 

49.50 

3.06 

7 

6 

5 

52.12 

3.03 

8 

5 

4 

45.14 

2.99 

9 

a 

8 

61.10 

3.19 

10 

4 

1 

42.38 

2.96 

11 

5 

4 

48.28 

3.03 

12 

7 

9 

53.82 

3.07 

13 

6 

3 

59.24 

3.17 

14 

7 

5 

44.14 

3.11 

13 

4 

55.84 

3.04 

16 

') 

5 

58.50 

2.96 

17 

5 

5 

49.52 

3.00 

IS 

6 

1 

58.94 

3.26 

19 

7 

7 

43.48 

3.07 

20 

4 

7 

51.08 

3.11 

21 

5 

4 

51.96 

3.04 

21 

7 

8 

52.80 

3.08 

23 

5 

8 

54 . 64 

3.17 

24 

5 

4 

52.70 

3.05 

25 

5 

6 

40.58 

3.08 

26 

8 

7 

62.44 

3.33 

27 

4 

3 

42.76 

3.08 

28 

7 

6 

51.10 

3.01 

29 

7 

8 

49.89 

3.06 

30 

6 

6 

56.28 

3.20 

31 

4 

2 

46.00 

3.11 

32 

6 

5 

52.56 

2.91 

Ml' AN 

5 . 75 

5.28 

51.79 

3.08 

SD 

1 . 1 9 

2.20 

5.91 

.09 

SE 

.21 

.39 

1.05 

.02 
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TABLE  17.  BIOGRAPHICAL  DATA  FOR  THE  GROUP  USING 
THE  REDUCED  TRAINER:  APTITUDE  TEST  AND 

PRECEDING  NAVAL  TRAINING  COURSE  SCORES 
N = 29 


STUDENT 

VT-10 

VT-10 

N!\-i:;ers 

AFQT 

FAR 

ACADEMIC 

PRACTICAL 

I 

A 

A 

51  .OA 

3.02 

2 

A 

1 

A8.80 

3.12 

3 

6 

5 

51.00 

3.51 

A 

5 

A 

A2.66 

2.90 

5 

7 

7 

52. 2A 

3.26 

6 

6 

5 

50.10 

3.00 

7 

8 

9 

A 9. 56 

3.06 

8 

9 

9 

63.16 

3.35 

9 

3 

9 

A8.98 

3.08 

10 

8 

6 

59.86 

3.21 

11 

A 

6 

52. 6A 

2.99 

12 

8 

5 

51.06 

3.08 

13 

8 

A 

59.  AA 

3.17 

lA 

8 

8 

53.60 

2.97 

15 

6 

7 

A9.58 

3.10 

16 

5 

6 

53. A2 

3.18 

17 

5 

A 

50.88 

2.97 

18 

A 

8 

58.68 

3.23 

19 

8 

A 

A8.28 

3.09 

20 

8 

9 

60. A6 

3.36 

21 

7 

2 

A 1.78 

3.07 

22 

7 

8 

57.70 

3.20 

23 

8 

‘1 

50.28 

3.07 

2A 

5 

1 

A5.7A 

3.0A 

25 

6 

7 

55. A6  . 

3.16 

26 

7 

5 

50. AO 

3.05 

27 

7 

9 

Al.AA 

3.00 

28 

7 

7 

A 9 . 5A 

3.0A 

29 

6 

5 

5A.20 

3.02 

^^•:AN 

6.3A 

5.97 

51.79 

3.11 

SD 

1.61 

2. AO 

5. AO 

.13 

SE 

.30 

.A5 

1.00 

.02 
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to  ranks  lor  Llic  Mann-WhLtnoy  U tost.  Ranks  and  results  ol  comparisons 
between  the  two  p,roups  are  pri'sentcil  in  table  IS.  flie  tests  ol  sij’uifi- 
cance  indicate  that  the  group  Lliat  hail  used  the  enhanced  trainer  did 
slightly  better  in  these  two  inflight  phases  (p  - . 1A2.5  anil  .0‘101). 
Although  their  practice  on  the  traiiu'c  could  have  contributed  to  this 
better  showing;  again,  intersession  differences  in  experience,  and  the 
relative  unreliability  of  the  checklist  must  be  taken  into  account  in 
such  an  interpretation. 


SUMMARY  OK  RK.SlIhTS 


1.  Thi’  two  groups  iliil  ei[ually  wi*  1 1 on  the  t'ud-o I. -course  tiiinsfer 
test.  The  enhanced  group  was  rated  slightly  higher  on  the  inflight  check- 
list for  both  of  two  flight  training,  phases  (table  1)  (I  .able  IS). 

2.  file  group  using,  thi'  enhanceil  trainer  reipiireil  nioLc  practice  prob 
le.ms,  took  more  time,  ami  used  more  on-line  sessions  to  reach  the  final 
transitioning  criteria  at  ibO  knots.  These  differences  were  statistically 
significant  (p<.01),  but  the  measures  of  association  (u)  between  inde- 
pendent and  dependent  variables  were  relatively  low  (tables  A and  3). 

3.  Although  the  uLtference  between  means  (20.18)  of  number  of  dynamic 
problems  attempted  (variable  A,  table  A)  was.  significant,  (p  - .0102), 

the  difference  between  means  of  number  of  dynamic  problems  correct  was 
only  3. A3  (p  = .Hb)  (variable  5,  t able  A). 

A.  On  practice  problems  the  two  groups'  scori'S;  reS])onse  latencies, 
missile  firing  scores,  number  of  turns,  ami  computational  errors,  were 
not  s ta t i s t i c;i  1 ly  s ig,nlf  icantly  dillerent  (t.ables  > and  b)  . 

3.  Practice  with  the  Lw(>  versions  of  tin-  trainer  resulted  In  markeil 
improvement  In  fluency  (as  measured  by  response  latencies)  and  proficiency 
(as  measured  by  missile  firing  scores  and  number  of  turns)  In  both  groups 
(tables  7,  8,  0,  10,  and  11). 

6.  There  were  iliffercnees  between  the  two  g, roups  In  trenils  in  accuracy 
measures  across  the  successivi*  U'vels  (table  12). 


7.  The  attitudes  of  the  two  g, roups  toward  the  two  versions  of  the 
trainer  were  in  the  favorable  direction  (i)<.01)  (table  13). 


8.  'file  g.roup  using,  tlu’  enhancisl  version  ol  thi‘  trainei  e 
favorable  attitmli'S  toward  the  special  g,raphlcs  leatnres  th.it 
to  that  trainer  (p<.01)  (l.able  13). 


xpressod 
wore  speciCi 


c 


There  were  no  differences  between  tlie  backgrounds  of  the  two 
random  groups  with  respect  to  prior  test  scores  (t.ahles  lb  .and  17). 
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TABU']  IH.  COMPARISON  OK  RANKKl)  SCORKS  OK  TlIK  KNIIANCKl)  AND 
RK.DIICKD  CROUPS  ON  TIlK  INKLICMT  CIlliCKLIST  KOR 
'rWO  INKIJCIIT  TI^TNINC  PHASES 


STUDENT 

NUMHER 


RT-H  (R) 
RANK  SCORE 


RT-8  (E) 
1U\NK  SCORE 


RT-13  (R) 
RANK  SCORE 


RT-13  (E) 
RANK  SCORE 


1 1 . u 
37.'-) 

44  . U 

40.0 

4 . 0 

1.0 

4'.  .0 

5.5 

48.0 

9.0 

37.3 

21  .0 

40.0 

40.0 

35.3 

55.5 

32.3 

48.0 

33.5 

33.3 

29.3 

48.0 

26.5 

5.5 

33.5 

3.0 

29.5 

23.5 

26.5 

14.5 

44.0 

26.5 

50.5 

- 1.07;  p = . 1423 


z ^ 1.34;  p = .0901 


Score’s  compuLcil  with  corrections  for  tics: 
Mann-Whitiicy  U tost  (one-tailed) 

Scores  wrv  averap,es  of  checklist  data  lor  five-  llij-hts  (RT-8)  and  six 
flip.hts  (R'l’-13)  per  student. 

lilanks  indicate  four  students  who  v^^ere  droppod  from  the  course  after  com- 
pleting the  RI-13  pliase.  Ihese  data  were  not  included  in  tlic  statistical 
tes  ts . 
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DISCUSSION  OF  RFSULi'S 

A CutulaiiKMiLn  1 problt'm  here'  is  l1i.il  iL  is  noL  possible,  in  liehl 
env  ironmonLs , Lo  coiiLrnl  adeqiiaLely  Lemporal  vaviables  over  Llie  iierioU 
of  L Imo  Lli.iL  .1  sLiuleiiL  is  jMiinp,  Llirniip,li  seliuol.  There  fiire,  Liu'  inacLicc 
session  UaL.i  eolleeLed  over  Lliis  period  undoubLi'dly  'a're  aCfecLed  by 
biases  oL  one  sorL  or  .inoLlier  LhaL  imisL  be  Laken  iiun  eons  i dera  L ion  when 
dr.Twiny  eonclusions  I roiii  tiu'Si'  il.iL.’i.  llie  bi'St  claLa  heie,  Lhose  from  Lhe 
eiul-oC-pracLiee  Lranster  LeSL,  iiulicaLi-  llinl  Lhe  experimeiUal  j'.raphics  had 
no  observed  effeeLs  on  Lhe  final  ;u  i nraey  or  ilueney  seores  of  Lhe  ^;roiip 
LhaL  used  Llu'm  in  eomp.irisoii  lo  Lhe  pronp  Lh.iL  dii.1  nol  use  Lhein  ilurin;', 
jiracLice.  The  Lwo  p, roups  |>er(onned  equally  well  on  Lhis  Lranslei  lesL. 

The  daLa  from  Lhe  elieekiisL  usi-d  ilurinj-,  Lhe  Lwo  phase's  of  acLual  tlipliL 
operaLions  imlie.iLe  Lh.iL  Lhe  sLiidenLS  who  used  the  I'lihaneed  version  ol 
Lhe  Lrainer  did  perform  somewhaL  bi'LLer  in  the  .1  ir  Lh.an  lhe  other  p,rou]i. 

These  ilaL.a  eovereil  .1  LoLal  ol  eleven  praeLii'e  I 1 ip.lils  pt'i  sLiidc'iiL. 

Several  pos  L Ime  , .1  1 Lern.i  L ive  I'xp  1 ana  t i ons  for  the  .ihservi'il  dilLefinces 
.aniong  j^roiijis  in  Lhe  pr.ieliee  session  tl.iLa,  are  possible',  biiL  tuiLhei  experi- 
meiiLation  would  he  re-iiuin-d  Lo  <-oiiipleLely  reseilve  llie  various  issues  Lhal 
have  been  raised.  These  are  pie-senLe-el  in  onler  of  Lheir  power  Lo  explain 
Lhe  daL.i. 

1.  The  enhanee'd  j;roup's  higher  error  rate  in  compuLing  v;iliu-s  of  Lhe 
intercepL  Lriangle  (Table  12)  might  aeeounL  lor  Lhe  lacLS  Lhat  Lliis 
group  requireel  ;in  average  of  2eH  more  problems  .ind  2.8  more-  hours  during 
practice.  lU'call  th;it  their  preifieiency  sceirt-s  (missile  firing  and  number 
ol  turns)  nevertheless  essentially  were  equal  in  e'.ieh  practice  comlition, 
and  that  their  latency  scores  to  compleLe  the  Loteboard  were  usually  a 
second  or  more-  sleiwer.  .lust  one  computaL  ional  error  in  the  dynamic  phase 
of  practice  (220  through  4(i()  knots)  woulil  result  in  (1)  that  problem  noL 
being  counted  correct,  (2)  the  stiidenl  being  allowed  to  finish  Lhe  iuter- 
•'.cpt,  (1)  his  number  of  turns  and  missile  pH  i t scores  being  incliKh-d  in 
Lhe  d.iLa,  anil  ('i)  the  problem  noL  being,  repeated  in  1 ree  fly.  I'hu  it 
apiH-ars  Lhat  ;i  r i Llime  L i ■ accuracy  was  weighted  too  heavily  in  the  scoring 
and  the  Lr.ins  i t ion  ing  criteria.  It  is  apparent  that  these  errors  did  not 
prevent  the  enhanced  group  from  nuking  as  gonti  intercepts  as  the  other 
group  (T.ible  12). 

2.  The  d.-it.i  in  tabli-  12  also  sug,g,est  Ih.il  Liu-  static  tri.ing.Ie,  as 
supplied  continuously  in  static  mode  1,  and  .1 1 ter  an  error  in  static  mode 
11,  might  h.ive  h.-en  distracting,  to  the  studenls  in  lhe  enhanced  group 
idiile  they  wen-  perlorming  mental  arithmetic,  since-  they  required  ;in  .aver- 
age of  l'i.34  and  0.71  seconds  longer,  an<l  their  error  rates  were  suhstan- 
tially  higher,  .93  versus  .71  and  .76  versus  .48.  'This  supports  the  first 
cxplan.ation  above. 

3.  ‘The  bogey  Lr.ick  history,  opLiiiul  intercept  p.ith,  .and  dynamic  triangle 
were  displayed  to  the  experimental  group  during  introductory  problems, 

and  also  when  problems  were  repeated  in  Iree-Tly  mode.  Repented  problems 
constituted  24/  to  277.  ol  the  tot.al  dynamic  probb-ms  att(-mnled  lor  both 
groups.  Therefore,  this  mode  contaiiu-d  part  ol  the  treatmi-nt  ditference 
between  the  two  groups.  However,  the  effectiveness  of  repeating  luvhlems 
may  have  diminislu-1  during  later  stages  of  learning  (practite  lor  fluency). 
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. Ill  (.1' ■ I ioM  sLiuly,  in  wlticli  a major  ol) jorL  ivc  was  Lo  Lost  Llio 
"siirv  ivabi  1 i t ' ol  Llu'  traim-r  in  a scl»ool  oiiv  i romiu'ii  I , it  was  impossible' 
to  control  all  variables  that  miplit  influence  outcomes,  in  aiKlition  to 
the  inrinenee  of  tlie  i ntlepeiulen  t variables.  I’ov  example,  we  learneil  tli.it 

some  of  the  stiuleuts  wlio  were  b;ivin>;  nniisna  1 >1  i M i i u 1 1 i es  in  j'.raspinp, 

re  l;i  t ionsli  i ps  between  true  and  ri'lative  motion,  or  in  learning,  to  eomimti' 
till'  V, line's  ol  iiUerei'pl  tri.inp.le  v.iri.ibles,  or  in  li'arninj',  otlie-r  b.asic 
interce'pt  p reie' e'el  n re'S  , we're  j'ive'ii  eielel  i t iiHl.i  1 all.e'i  lunil  S pitietiee*  on  tile 

traine'r  b'/  tbe'  sclioei  1 . This  was  t.be  siluieil  s pre'i'oj^.a  t ive' , anel,  in  l.Kt, 

it  indicates  tlieir  confideiiee  in  tbe  traiiu-r.  We'  ean  enily  assimie  tbe 
e'ffe?cts  We're  r.anelenii  across  p, roups.  Alsei,  it  was  not  possible'  te)  sedieeliile 
individual  practice  sessienis  on  tin-  trainer  te)  r ipi’ieuis  ly  control  inter- 
scss  ion- Intervals  be'canse'  tliplit  sclie'elu  les  uiiile' rs  t .uidnb  1 y bael  prieirity. 

The'  t'nbance'el  prenip  m.ay  have'  li.ael  a le'SS  I aveir.ib le'  i nte'i  sc.ss  iein  stlu'dnle'  1 tom 
the  standpoint  of  el  i s t r.ic  t ions  , intersess  ion  lorpettinp,  or  for  motivation 
te)  learn  th.'in  the  re'ehiceel  p,re)up.  11  so,  tlu'y  ce)iilel  h.ive'  re'e:]nireel  ineire' 
time  and  take'ii  meire  problems  ehirinp  practice'. 

5.  A tilth  possibility  is  that  the  pronp  usinp,  the'  enhanced  trainer 
actually  came  from  ;i  d i f fe'Ce-n  t poi)ulatie)n  with  re'spect  to  some  correlate(s) 
elf  the  ele'penele'iit  iiie'.is  nre'S  . Altliou}',b  the'i'i'  .are'  ve'ry  sliplit  el  if  fercncc'S  in 
the  Ai’t^r  scores  for  tie.'  two  p.roups,  the'  score's  frenii  a prece'dinp,  naval 
training  course',  VT-10,  are'  e'sse'ntial  ly  the*  s.iitu'  (tables  lb  anel  17)  . In 
this  regarel,  Stanley  .anel  Campbell  have  this  te)  s;iy  .about  the  posLtest-only 
control  group  design: 

While  the  pretest  is  a concept  keenly  embeeleleel  in  the 
thinkinp,  of  research  workers  in  eilnc.ation  anel  psych- 
ole)j',y,  it  is  not  .actually  essential  to  true  experi- 
mental  designs.  For  psyche) logica  1 reasons  it  is 
difficult  to  g, ive'  up  "kneiwinp,  for  sure’"  that  the’ 
expe'C iiiu'ntal  and  eeentrol  greuips  we- re*  "eepi.al"  be’ lore 
the  el  if  ferent  ia  1 expe’riinenta  I tri’atment . Noiu-theless, 
the  most  .leleepiate  all-puriiose  .assurance'  ol  lack  of 
initial  bi.ases  betwe'cn  groups  is  random ix. a t inn . With- 
in the’  1 imits  ol  e'eenf iele’iice'  state'd  by  the’  te’sts  of 
significance,  r.anelomi '/.at  ion  can  sufI  ice  without  the 
pretest.  Actually,  aliiieest  all  e)f  the  .agr  i cul  tur.al 
e’y.pe’ r i me-n  I in  the'  l''i.she’r  (1'12'),  1 ‘Mb)  traditie)ii 

.are'  without  pre'te’St. 

Kanelomization  procedure'.",  were  t.auglU  to  the  Tl)  technicians  who  monitored 
the  operation  ol  the  tr.ainer  .at  tlu'  sche)e)l.  Kach  ne-’v  class  of  students 
was  to  be  el  iv  tdeel  into  t wo  r.aneh)m  g.reeups,  using,  a table  of  random  numbers 
anel  the  stanelarel  random i /-.a  t ie)ii  techniepie'S  . 


Ul.'inipbeJ  .1  'lud  .■|,'i.u  I ' y , 1‘16  5,  [).  db. 
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CONCLUSIONS  AND  RECOMMl^NUATIONS 


Cone  lus  ion.‘. 


1.  The  trainer  described  in  this  series  of  reports  was  designed  to 
develop  fluency  in  Radar  Intercept  Officers  in  performing  basic  procedures 
in  air  intercepts.  The  two  sets  of  data  from  the  field  trials  in  the  RIO 
school  amply  substantiate  the  assertion  that  the  trainer  did  what  it  was 
designed  to  do.  Some  comparisons  between  this  self-standing,  CAI  system 
in  a terminal  and  the  conventional  radar  trainers  at  the  school  are  of 
interest; 

2.  The  hardware  cost  of  tlie  Behavioral  Technology  Laboratories 
trainer  was  $24,000  versus  approximately  10  times  that  for  each  radar 
trainer. 

3.  The  BTL  trainer  automatically  recorded  objective  measures  of  the 
performance  of  each  student.  The  radar  trainers  had  no  provisions  for 
doing  this. 

4.  Modifications  and  extensions  in  the  scope  of  tlie  procedures  taught 
by  the  trainer  could  be  made  relatively  inexpensively  by  program  changes. 

For  example,  differential  altitudes  and  speeds,  and  radar  operating  pro- 
cedures could  be  incorporated,  thereby  making  the  radar  trainers  unnecessary. 

5.  Although  a technician-instructor  was  present  to  assist  students 
while  the  trainer  was  in  operation,  further  refinements  in  the  data  analysis 
programs  would  make  this  unnecessary.  The  trainer  is  essentially  auto- 
matic. One  instructor  could  monitor  a room  full  of  trainers.  The  radar 
trainers  required  a 1:1  instructor-student  ratio  for  active  learning. 

6.  The  trainer  incorporated  error-correcting  feedback  and  adaptive 
control  sensitive  to  each  student's  entering  skills.  None  of  these  features 
were  in  the  radar  trainers. 

7.  The  hardware  used  for  tliis  trainer  is  general-purpose.  It  is  only 
necessary  to  load  a different  program  to  teach  a different  course.  With 
the  addition  of  a floppy  disk  and  10  interface,  any  one  course  from  a 
library  of  courses  could  be  loaded  in  a few  seconds  and  detailed  student 
records  could  be  kept  on  cheap  disks  (approximately  eight  dollars)  for  as 
long  as  desired.  Needless  to  say,  the  radar  trainers  lacked  this  flexi- 
bility or  this  capability. 

8.  The  possible  instructional  effects  of  the  bogey  treck  history,  op- 
timal intercept  path  and  dynamic  geographic  displays,  evidently  were  masked 
(1)  by  distracting  effects  of  displaying  a static  intercept  triangle 
while  students  were  performing  mental  arithmetic  preparatory  to  initiating 
the  dynamic  phase  of  tlie  problem,  whicli  nuiy  have  caused  the  observed 
higher  arithmetic  error  rates  in  the  experimental  group,  and  (2)  by  insuffi- 
cient exposure  of  these  instructional  aids  to  the  students  in  an  error- 
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remediation  loop. 

9.  However,  it  also  is  likely  that  these  instructional  aids,  exclud- 
ing the  static  triangle,  would  have  been  effective  only  in  very  early 
stages  of  praetice  for  accuracy.  In  later  stages  of  practice  Cor  fluency, 
external  stimulus  control  over  behavior  is  greatly  reduced,  for,  by  that 
time,  the  student  has  acquired  mental  representational  structures  capa- 
ble of  guiding  his  performance  without  external  aids. 


Recommendations 


1.  PSO  CAI  sliould  be  applied  and  tested  in  otlier  areas  of  Navy  train- 
ing, using  current  of f- tlie-sl\el f hardware,  to  fully  develop  the  concept 
and  to  accumulate  more  information  about  CAI  system  varial)les. 


2.  A study  sliould  be  undertaken  to  develop  a design  for  a CAI-system- 
in-a  terminal,  based  on  wliat  lias  been  learned  here,  taking  into  account 
current  and  forseeable  advances  in  electronics  technology,  instructional 
technology,  and  computer  science.  The  appearance  on  the  market  of  a hand- 
held s tored-program  computer,  complete  micro-processors  on  a .15  inch  square 
silicon-on-sapphire  LSI  chip,  and  electronic  watches  with  liquid  crystal 
displays,  are  signs  of  the  current  revolution  in  electronics  that  will 
make  this  type  of  system  feasible,  attractive,  and  cost  effective. 


3.  The  results  of  the  study  reported  here,  relative  to  the  effective- 
ness of  special  graphics,  should  not  be  generalized.  The  independent 
variable  actually  was  a complex  of  fixed-effect  variables;  thus  generaliza- 
tion is  not  statistically  possible.  It  appears  that  it  would  have  been 
bettor  to  schedule  those  grapliics  entirely  in  the  front- loading  rather  than 
in  the  practice  and  remedial  sections  of  the  PSO  CAI  instructional  strategy. 
There,  a period  of  "free  practice"  on  problems  designed  to  teach  the  stu- 
dent how  to  extract  the  maximum  instructional  value  from  the  graphics,  and 
during  which  students  wore  reinforced  for  using  them,  possibly  would  have 
been  a more  effective  use  of  tlieso  instructional  aids. 
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ai>i’i-;ni)ix  a 

l:l()  STIIMKNT  (^IIKSTIONNAIRK  - l‘ NllANCi:i)  VKRSION 
N = 31 


111  coinpM  r I sou  witli  oLIut  similar  li'ai’ninj^  i‘X|K‘r  i t'nccs  , tlif  rc'Ct'iit 
c'xpi'r  i c’lici'  wiLli  Llu'  iiiLc’riH'pL  Lrainor  was: 

n.  V'ory  i-n  joyah  1 c (A) 

1).  Kn  joy.ib  1 (.'  ( I')) 

c.  Neutral  (II) 

d . Iki  r i n p,  ( 2 ) 

e.  I’xtreinely  boriii,n(l) 

As  a mc'Lhoil  lor  Loacliiiip,  ojicrating  procedures,  tlie  intercept  training 
system  was: 


a . 

V’ery  id  fective 

(3) 

If- 

Iv  r fee  t i ve 

(l«) 

c . 

Average 

(«) 

d. 

Ine  f fee  t i ve 

(')) 

V . 

\tery  ineffective 

(1) 

3.  While  using  the  intercept  training  systi'ni  to  learn  operating  pro- 
cedures, I would  have  I iked  to  have*  had  tlu'  svsti'iu  answi'r  tor  me; 


n . 

Very  manv  questions 

(1) 

1). 

Many  more  questions 

0) 

c . 

A few  more  cjuestions 

(11) 

cl. 

No  more  (|uestions 

(lb) 

(* . 

No  c|uestions 

(2) 

A.  Viith  llu'  presence  ol  an  instructor  and  fully  operating  equipment  1 
feel  that  intercept  procedures  would  have  been  learned: 


.1  . 

In  a much  shorter  period  ol  tra 

i n i nj; 

(2) 

b. 

In  a shorter  period  ol  training 

(») 

c . 

In  about  the  same  t i nii' 

(lb) 

tl. 

In  1 longer  period  of  training. 

(5) 

V . 

In  a much  long,er  period  of  training 

(0) 

The 

interi’ept  tiMiuer  is: 

.*1 . 

Very  easy  to  iu;e 

(7) 

b. 

K.asy  to  use 

(II) 

c . 

N’either  easy  or  difficult  to  us( 

• (‘1) 

d. 

l)i  f f i cu  1 1 to  use 

( 0 

e . 

Very  d i f 1 i eu  1 ; to  use 

(0) 

I'll!'  iiiili,il  i 11.  t riK' t i on  }*iviii  on  how  Lo  iisi'  1 ho  i iiLoroopt  LiMinrr 
w.-p. ; 


,1 . Miu  h moil'  tli.in  .nlotiii.i  I o lo  niy  lu'i'ih'  il) 

h , i I II  III  ,nh’<|u,ili'  lo  iiiv  iiiM  ih;  f'I'l 

\(li 'ipi.i  1 1 1 o my  111  pih:  ( I () ) 

d . lli.in  .iilpiiii.ilo  lo  iiiv  iii'i'il:;  I 'i ) 

e.  Muili  loss  Lli.'in  ;iil('(|ii:i t c lo  my  noiil.':  fl) 


About  bow  Ion;',  cl  id  il  t.-iko  yon  lo  Uvnii  lo  iililizo  llio  i nl  citpiU 
I iM  i nor 


More 

than  two  hours 

(-') 

b. 

Abou  L 

two  hours 

(b) 

c . 

About 

1-1/2  hours 

('•) 

(1. 

About 

1 hour 

ni) 

c’  , 

Abou  t 

1/2  o 1 the  III 

1 hour 

(‘1) 

Tlio  i iniiiod  i .1 1 o knowl od)',i>  ol  oi  ror::  providod  liy  llio  iiUoroo]U  Lraiiicr 
.1 . Croatly  aidod  loarnin;;  KIO  opiralini',  iirofodiiro;;  (.^t) 


li.  ALilod  loa riling  (lb) 

o.  Mado  no  d i f 1 orc-'iioo  in  li'amini’,  (11) 

d.  Ilinclorccl  loarnin;'.  (0) 

o.  C.roally  liindorod  loam  ini'  (0) 


Sialio  iiiodo  rc  <iiiiros  ilial  yon  porronii  m c ossary  ar  i i liinot  io  c onipula 
I ioiir  willioiil  orror  in  a .si>oo  i 1' i i>d  Liiiio  I ranio  boU'ro  coni  i mi  i np, 
willi  i lUoroopl;-! . Did  yon  I iml  Ibis; 


a.  \'orv  liolpl'iil  in  loarning  (*>) 

1).  liolpl'iil  in  learning  (D) 

o.  Neill  ral  (b) 

d . 01  vorv  I i l l I o he  1 p (3) 

o,  01  iu>  help  (0) 


The  iiiU  roepl  iraiiu  r repeals  an  inlereep'  in  l''rc  c'  l-'ly  Display 
lonnal  whore  yon  did  not  achieve  crilerion  liring,  posilion  in  I he 
inilial  alUiiipl,  I'liis  allows  yon  to  review  the  iiiLercept  and 
lierceivc  your  errors.  Did  yon: 


a.  Si  rung ly  like  ibis  capability  (11) 

b.  hike  ibis  capability  (13) 

0.  Nave  no  like  or  dislike  lor  this  capabMily  (ti) 

d.  Dislike  this  capability  (1) 

e.  Slroiijily  dislike  Ibis  cap.-ibiliLy  (0) 


In  I’roo  l‘‘lv  yon  loiild  obsi'rvo  tin  .'e  I a t i onsli  i ps  between  interci'pt 
geoiiielry  and  radar  presentation  diirin;'  an  intercept.  Did  you  use 
Ibis  featureV 


12.  II  ymi  ii.^ieil  l-'rci'  I'ly  in  tin*  nbovo  w:\y,  do  yon  holiovi.'  it  wa.s: 


a . 

Very  helpful  in  Ic'arning 

(■ 

h. 

lleliiful  in  learning 

( ^) 

c . 

Neut  ra 1 

(6) 

d. 

Of  very  little  help 

0) 

e . 

Of  no  helj) 

0) 

rj.  Fn  I’roi'  I'My  Moilo,  tlu*  Trainoi  provide.s  an  "optimal  path"  for  the 
boj;oy.s  track  down  the  seopc,  and  a dottc'd  "track  hi.story"  of  the 
bop,ey's  actual  path.  As  a metlioci  (,f  as.sociatinp  intercept  geometry 
with  scope  presentation  the.se  aids  were: 


a.  Vi'ry  I'ffi'ctivc'  (7) 

b . l-i  1 fee  l i ve  ( 1 0) 

c.  Averajp'  (12) 

d.  Ineffective  (1) 

e.  Very  iiu'ffective  (1) 


In.  The  trainer  automatically  provichws  a .sani|)lc*  problem  in  I’ree  fly 

mode  when  advanciii)’,  or  changing  problem  category.  Thi.s  feature  is: 


n . 

Very  helpful 

(7) 

b. 

Helpful 

06) 

c . 

Neutra 1 

(5) 

cl. 

Of  very  little  help 

0) 

V . 

01  no  help 

(2) 

15.  During  the  progress  of  any  int(>rci-pt  you  may  display  the  intercept 
triangle  by  depressing  the  TlU  key.  When  tlie  triangle  is  displayed 
you  will  also  see  an  "optimal  path"  and  "track  history"  displayed 
on  the  "15"  scope.  In  clarifying  the  problem  solution,  this  aid  was: 


a . 

Vi'ry  olfective 

(6) 

b. 

K f fee  t i ve 

(101 

c . 

Neutra 1 

(15) 

d . 

1 ne  f fee  t i ve 

O) 

e . 

Very  ineffective 

(0) 

16.  The  radar  siniulal  ion  provided  by  tlu‘  intc'rcept  trainer  was: 


a.  Much  more  than  ;iile(|uaLe  for  learning  b.is  ic  iiitt'rcepL  procedure  (2) 

h.  Mori'  than  adeipiate  lor  learning,  basic  intercept  procedures  (6) 

c.  Adet|uate  for  learning,  basic  intercept  procedures  (20 

d.  I.ess  th.in  adei|uati'  lor  learning  basic  intercept  procedures  (2) 

e.  Much  less  than  adequate  lor  learning  basic  intercept  procedures  ( 1 ) 


17  Wc're  there  any  particul.ir  intercept  problems  that  were  confusing? 


i:iO  STIIDKNT  qilllSTlONNA  IKK  - KKIIDCHI)  VFKSLON 
N = 2S 


1.  In  L omp;ir  i son  with  oLlior  similar  iisirninj;  L'xpL'r  it-ncvs  , tlio  loccnl. 
c'xpor  ioiu't'  v\/illi  llu'  intt‘rtv|it;  trainer  was; 


a . 

Very  enjoyable 

O) 

b. 

bn  joyab  1 1> 

(13) 

c . 

Neutra 1 

(6) 

<1. 

Hor i ng 

O) 

c’  . 

Iwxtrenu'ly  boring 

(0) 

As  a mcLliocl  I'or  Lcacliinp;  o|K‘ral  inp,  proo'clnros , tlio  inlfrcf'pt  Lraininp 
sys  Loni  was ; 


a . 

Very  (.'ffective 

(3) 

b. 

I'it  fee  t i ve 

(13) 

c . 

Average 

(h) 

d. 

Incf feet ive 

(3) 

0 . 

Very  int' lifi-c  t i ve 

(0) 

1.  Wliilo  using  Lite'  iiuorcopt  Lraininp,  sysLt'm  to  Usirn  optM'nriiv;  jiroev- 
ilnros,  I \TOiild  have  liked  to  have  had  Llu-  system  answer  lor  iiu‘: 


a . 

Very  iiuiny  questions 

«)) 

b. 

Many  more  questions 

C^) 

c . 

A few  more  (|uestions 

a>) 

d. 

No  more  questions 

MO) 

c . 

No  questions 

;/) 

A.  With  the  presence  of  an  instructor  and  fully  opi-rating  equi])nient  1 
feel  that  intercept  procedures  would  have  been  learned: 


a.  In  a much  shorti-r  i)eriotl  of  triiining  (O') 

h.  In  a shorter  period  of  training  (13) 

c.  In  abtnit  the  stniie  time  (5) 

d.  In  a longer  period  of  training  (5) 

e.  In  a much  longer  perio<l  of  training  (2) 


5.  The  intercept  trainer  is: 


a.  Very  easy  to  use  (10) 

b.  basy  to  use  (>)) 

c.  Neither  isisy  or  ilillicull  to  use  (b) 

il . l)i  if  i cu  1 1 to  use  (0) 

e.  Very  iliffieull  to  use  (0) 
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The  initial  instruction  given  on  how  to  use  the  intercept  trainer 
was ; 


a.  Mucli  more  than  adequate  to  my  needs  (2) 

b.  More  tlian  adequate  to  my  needs  (5) 

c.  Adequate  to  my  needs  (12) 

d.  Less  than  adequate  to  my  needs  (6) 

c.  Much  less  than  adequate  to  my  needs  (0) 


About  how  long  did  it  take  you  to  learn  to  utilize  the  intercept 
trainer? 


a . 

More 

than  two  hours 

(2) 

b. 

About 

two  hours 

(6) 

c . 

About 

1-1/2  hours 

(2) 

d. 

About 

1 hour 

(7) 

e. 

About 

1/2  of  the  first  hour 

(8) 

The  immediate  knowledge  ol  errors  provided  by  the  intercept  trainer: 
a.  Greatly  aided  learning  KIO  operating  procedures  (2) 


b.  Aided  learning  (1-7) 

c.  Made  no  diCference  in  learning 

d.  Hindered  learning  (2) 

e.  Greatly  hindered  learning  (0) 


Static  mode  requires  that  you  perform  necessary  arithmetic  computa- 
tions without  error  in  a specified  time  frame  before  continuing 
with  intercepts.  Did  you  find  this: 


a. 

Very  helpful  in  learning 

(5) 

b. 

Helpful  in  learning 

(13) 

c . 

Neutral 

(4) 

d. 

Of  very  1 i ttle  help 

(3) 

e . 

Of  no  help 

(0) 

Tlio  intercept  trainer  repeats  an  intercept  in  Practice  mode  format 
wliere  you  did  not  acliieve  criterion  firing  position  in  the  initial 
attempt.  This  allows  you  to  review  the  intercept  and  perceive 
your  errors.  Did  you: 


a.  Strongly  like  this  capability  (5) 

b.  Like  tliis  capability  (13) 

c.  Have  no  like  or  dislike  for  tins  capability  (4) 

d.  Dislike  this  capability  (3) 

e.  Strongly  dislike  this  capability  (0) 
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14.  The  trainer  an LomaL ica 11 y provides  a sample  prohUsu  in  TracLice  mode 
when  advancing,  or  changing  prohUsii  catej-ory.  This  U-ature  is; 

a.  Very  helpCnl  (^) 

b.  llelpi'al 

c.  Neutral  (^) 

d.  OC  very  little  help  (0) 

e.  Of  no  help  (0) 

16.  The  radar  simulation  provided  by  the  intercept  trainer  was; 

a.  Much  more  than  adequate  for  learning  basic  Intercept  procedure  (0) 

b.  More  than  adeijuate  for  learning  basic  intercept  procedures  (/) 

c.  Adequate  for  learning  basic  intercept  procedures  ( ) 

d.  Less  than  adequate  for  learning  basic  intercept  procedures  (5) 

e".  Much  less  than  adequate  for  learning  basic  intercept  procedures  (0) 

17.  Were  there  any  particular  intercept  problems  that  were  confusing? 
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